Databricks Delta Connector

Back Next

Determine the order of processing for multiple targets

When you configure a mapping to write to multiple targets in a single pipeline, you can configure each target for any of the write operations. The order of the target operation is not deterministic.

However, if you want to process the target operations to process in a specific order such as delete, update, and insert, you need to set certain properties either in the Secure Agent or in the task properties.

Set -DEnableSingleCommit=true in the Secure Agent properties

Perform the following tasks to set the property for the Secure Agent:

Open Administrator and select

Runtime Environments

Select the Secure Agent for which you want to set the property.

On the upper-right corner of the page, click

Edit

In the

System Configuration Details

section, select the

Type

DTM

for the Data Integration Service.

Edit the JVM options and set the property to -DEnableSingleCommit=true.

Set the EnableSingleCommit property in the task properties

Perform the following tasks to set the property in the task:

On the

Runtime Options

tab in the mapping task properties, navigate to the Advanced Session Properties section.

From the

Session Property Name

list, select

Custom Properties

, and set the Session Property Value to

Yes

Rename Saved Search

Table of Contents

Databricks Delta Connector

Databricks Delta Connector

Determine the order of processing for multiple targets

Determine the order of processing for multiple targets

Set -DEnableSingleCommit=true in the Secure Agent properties

Set the EnableSingleCommit property in the task properties