Ingest incremental change operations into audit tables on the target
Ingest incremental change operations into audit tables on the target
For database ingestion incremental load and combined initial and incremental load tasks that have Snowflake targets, you can configure the tasks to ingest data directly to audit tables on the target system, instead of merging and applying changes to a target database.
Consider using an audit table when you want to perform downstream computations or other processing on the data before writing it to the target database or when you want to examine the changes.
Ensure that no constraints other than indexes exist on the audit tables.
When you define the task, you must select
Audit
in the
Apply Mode
field on the
Target
page to enable the use of audit tables. This field is available for new or undeployed tasks. The audit tables are created, one for each source table, the first time the job runs.
Under
Advanced
on the
Target
page, you can optionally select check boxes for adding metadata columns to the audit table:
Select the
Add Operation <
type
>
check boxes to add columns that contain metadata for DML change operations, such as the operation type, time, transaction ID, and owner, and a generated ascending sequence number. The columns are populated when data is loaded to the target audit tables.
Select the
Add Before Images
check box to add _OLD columns that contain before-image data. You can then compare the old and new column values in the audit tables.
Select the
Audit Columns Prefix
check box to add a prefix to the names of added metadata columns to differentiate them from other table columns. Default is INFA_.
ASK INFAPreview
