Data Migration
Conversion jobs: folder option for source data and target data output
- In step 3, set the 'Destination' option to "Output data files to folder" and select a folder to output the conversion run to. This places the outputted data and log files in a folder in the general files areas. Each time the job runs the previous run's output is moved to an archive folder inside the selected folder.
- In step 5 (select data), For each schema where this is needed, toggle the 'Assign folder' on and select the folder where the source data files are or will be. At run time the conversion will use the files in the folder that match the table names.
- The same folders can be used for outputs in one conversion and sources in another conversion. This allows for chaining of conversion jobs without needing to go into the job each and specifically select the data source files each time.
- The same output folder can be used for multiple conversion jobs, allowing outputs to be collated.
- As these files are in the general area, they can be renamed, moved and deleted by user with appropriate permissions, it is recommended that the folder structure for files used in the conversion jobs is well defined and understood by the team.
JOIN statement validation and AI assistant (beta)
- Check JOIN statement is valid before running
- Use the 'JOIN generator' to create the SQL statement.
Data Lineage
- AI Lineage Assistant and embedding performance improvements.
Utilities
- Data Files: De-duplicate records
Platform updates
-
Improvements to file and assets handling
- Auto-scaling enhancements