Ability to apply deletes as soft deletes on the target
Ability to apply deletes as soft deletes on the target
For
application ingestion and replication
incremental load and combined initial and incremental load jobs that have any supported source type and a Databricks, Google BigQuery, or Snowflake target, you can configure the task to process delete operations on the source as soft deletes on the target.
A soft delete marks a deleted row as deleted without actually removing it from the database. The row is applied to the target with the value of "D" in the generated INFA_OPERATION_TYPE metadata column.
You can use Soft Deletes only if all of the source objects have primary keys and the source does not allow the primary key values to change in any row after the row is first created. If the primary key values change, duplicate rows might be written to the target, causing the target to become corrupted.
Example scenario: Your organization wants to use soft deletes in a data warehouse to mark the rows that were deleted at the source while still retaining the rows for audit purposes.
To enable soft deletes, set the
Apply Mode
field to
Soft Deletes
on
Target
page of the task wizard when you configure the ingestion and replication task.