This article lists maintenance updates for supported DataForge versions.
DataForge Version 7.1
- May 13, 2024
- After Key bulk reset CDC, history table AND enr files are hyper-partitioned
- Clone of Group containing unique rule template causes error
- Unable to clear output channel filter
- April 9, 2024
- Email alert sending now supports TLS 1.2
- Added option for custom "send from", configured through Terraform variable using smtpCustomSendFrom variable or updated in Service Configuration UI page
- Azure environments can now configure S3 connections and pull files from S3 using Sparky ingestion. Currently only Sparky Ingestion and Scheduled initiation type are supported.
- March 28, 2024
- Long aggregate expressions time out in rule & rule template parser
- Rule template parser gets lost and returns bad relation chain
- Wrong export format for relation paths
- Allow data security mode to be saved on cluster configs
- March 22, 2024
- Token used in rule template returns token attribute name rather than value of attribute name
- Processes do not show up when switching projects
- [ Related sources list not showing any other than This when creating or changing rules
- Validation template can't be saved "Validation rule expression is not boolean"
- Inputs page not loading inputs past certain date / # of inputs
- February 28, 2024
- Custom SDK saves ingested raw attributes as string datatype
- December 15, 2023
- Output process tab doesn't seem to show in-progress outputs - it only showed up when it hit completed
- Shorten connection test error printed in Agent logs
- Auto-casting to timestamp in rules does not allow for specifying format and is buggy
- Output Process Tab Filtering
- Hitting X to wipe out cluster config job configuration libraries removes \[\] - throws wrapped error on save
- Usage disable-ingestion flag didn't flip back to false after upgrade wasn't able to start
- Support Self Relation with Unique Rule in relation expression
- Support Self Relation with Window Function Rule in relation expression
- Output Add All Source Columns maps Numeric type to String column type
- Source status failed not matching input status success
- Sparky File ingestion ignores connection path suffix
- Key bulk reset CDC breaks for file source when reading same file with no date parameter specified
- Clone fails if a non-templated rule references a templated relation
- Inactive dependencies marked active\_flag=true in project exports
- Relation Template expression is uneditable until reselecting the source to test
- Custom ingestion flipping disable ingestion after 3 failed ingestions
- Custom notebook cluster configs are allowed to be saved as Default Cluster Configuration, which shouldn't be allowed
- Can't access running process record when I have to scroll down because it auto refreshes
- Check for incorrect rule/relation parameters, warn, and write clearer error message than query gen
- Prevent adding multiple columns in the same output with same name
- Renaming a Group is saving the name locally even though actual saved failed.
forward slash in template name creates second level folder in project export/import - Refresh process spams history.process.record\_counts
- Project import sometimes doesn't update validation action code on validation rule
- Update sparky ingestion to match agent ingestion on raw file save path when file extension isn't listed
- If Driver Node is reclaimed we don't launch retries and things get stuck
- Attribute Recalc waiting to run on downstream\_lookup\_enrichment and
- Using date\(\) function in rule expression blows up API
- Clusters changed between cdc reset and output
- We allow saving a source as custom ingest with no custom cluster configuration attached
- After an import, connection value is empty in UI until manual refresh.
- Prevent period \(.\) for Hub View Schema
- Add a check for source name modification for a source with group and source template name
- Import fails when raw attribute or enrichment is removed from source
- Source process tab date filter functionality forward buttons not working
- Custom parse ignores force\_case\_insensitive parameter
- Agent file ingest fails with multiple directories in file mask
- Misspelling - null values detected message on rule validation
- Import doesn't validate connection type
- Remove single quotes around timestamp token for SFDC ingestion
- Remove single quotes around timestamp token for SFDC ingestion 7.1
- Processes are running multiple times when cluster is interrupted in AWS
- Hub table gets dropped and re-created multiple times
- Templatizing the source breaks relation templates pointing to it.
- Rule template can be created that references "actual" source name of templatized source
- Dropdown list of source template names in rule expression editor has duplicates
- Incorrect type mapping from sql server in sparky ingestion
- Connection test creates duplicates
- When API is not available, Agent takes long time to restart
- Processes get stuck in queued if disable ingestion is enabled at project and sources created from metadata
- Spaces in token names don't work when using token in attribute name of rule expression
- Port not added to connection string correctly in Sparky for MySQL \(and others\)
- Process date filter returning blank dates
- ENR query fails when JOIN is using unique enrichment attribute
Updated