Table of Contents

Search

  1. Preface
  2. Part 1: Introduction to Amazon Redshift connectors
  3. Part 2: Data Integration with Amazon Redshift V2 Connector
  4. Part 3: Data Integration with Amazon Redshift Connector

Amazon Redshift Connectors

Amazon Redshift Connectors

Bulk processing for write operations

Bulk processing for write operations

You can enable bulk processing to write large amounts of data to Amazon Redshift. Bulk processing utilizes minimal number of API calls and enhances performance of the write operation.
To enable bulk processing, specify the property
-DENABLE_WRITER_BULK_PROCESSING=true
in the Secure Agent properties:
Perform the following steps to configure bulk processing before you run a mapping:
  1. In Administrator, select the Secure Agent listed on the
    Runtime Environments
    tab.
  2. Click
    Edit
    .
  3. In the
    System Configuration Details
    section, select
    Data Integration Service
    as the service and
    DTM
    as the type.
  4. Edit the
    JVMOption1
    property, and enter
    -DENABLE_WRITER_BULK_PROCESSING=true
    .
  5. Click
    Save
    .
Not applicable to mapping tasks configured with pushdown optimization.