Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Bolo.

Table of Contents

Search

  1. Introducing Mass Ingestion
  2. Getting Started with Mass Ingestion
  3. Connectors and Connections
  4. Mass Ingestion Applications
  5. Mass Ingestion Databases
  6. Mass Ingestion Files
  7. Mass Ingestion Streaming
  8. Monitoring Mass Ingestion Jobs
  9. Asset Management
  10. Troubleshooting

Mass Ingestion

Mass Ingestion

Ability to apply deletes as soft deletes on the target

Ability to apply deletes as soft deletes on the target

For database ingestion incremental load and combined initial and incremental load jobs that have any supported source type and a Snowflake target, you can configure the task to process delete operations on the source as soft deletes on the target.
A soft delete marks a deleted row as deleted without actually removing it from the database. The row is applied to the target with the value of "D" in the generated INFA_OPERATION_TYPE metadata column.
Example scenario: Your organization wants to use soft deletes in a data warehouse to mark the rows that were deleted at the source while still retaining the rows for audit purposes.
To enable soft deletes, set the
Apply Mode
field to
Soft Deletes
on
Target
page of the task wizard when you configure the ingestion task. Also, make sure that the source tables have primary keys. Do not change the primary keys after you run the jobs.

0 COMMENTS

We’d like to hear from you!