Table of Contents

Search

  1. Preface
  2. Part 1: Introduction to Google BigQuery connectors
  3. Part 2: Data Integration with Google BigQuery V2 Connector
  4. Part 3: Data Integration with Google BigQuery Connector

Google BigQuery Connectors

Google BigQuery Connectors

Determine the order of processing for multiple targets

Determine the order of processing for multiple targets

You can configure a mapping to write to multiple targets in a single pipeline, with each target configured for any write operation. The order of the target operation is not deterministic.
However, if you want to process the target operations to process in a specific order such as delete, update, and insert, you need to set certain properties in the Secure Agent and in the task properties.

Set -DEnableSingleCommit=true in the Secure Agent properties

Perform the following tasks to set the property for the Secure Agent:
  1. Open Administrator and select
    Runtime Environments
    .
  2. Select the Secure Agent for which you want to set the property.
  3. On the upper-right corner of the page, click
    Edit
    .
  4. In the
    System Configuration Details
    section, select the
    Type
    as
    DTM
    for the Data Integration Service.
  5. Edit the JVM options and set the property to
    -DEnableSingleCommit=true
    .

Set the EnableSingleCommit property in the task properties

Perform the following tasks to set the property in the task:
  1. On the
    Runtime Options
    page in the mapping task properties, navigate to the Advanced Session Properties section.
  2. From the
    Session Property Name
    list, select
    Custom Properties
    , and set the Session Property Value to
    Yes
    .

0 COMMENTS

We’d like to hear from you!