Table of Contents

Search

  1. Preface
  2. Part 1: Getting Started with Snowflake Data Cloud Connector
  3. Part 2: Data Integration with Snowflake Data Cloud Connector
  4. Part 3: SQL ELT with Snowflake Data Cloud Connector
  5. Appendix A: Data type reference
  6. Appendix B: Additional runtime configurations
  7. Appendix C: Upgrading to Snowflake Data Cloud Connector

Snowflake Data Cloud Connector

Snowflake Data Cloud Connector

Configure bulk processing

Configure bulk processing

You can enable bulk processing to write large amounts of data to Snowflake. Bulk processing utilizes minimal number of API calls and the performance of the write operation is optimized.
To enable bulk processing, specify the property
-DENABLE_WRITER_BULK_PROCESSING=true
in the Secure Agent properties:
Perform the following steps to configure bulk processing before you run a mapping:
  1. In Administrator, select the Secure Agent listed on the
    Runtime Environments
    tab.
  2. Click
    Edit
    .
  3. In the
    System Configuration Details
    section, select
    Data Integration Server
    as the service and
    DTM
    as the type.
  4. Edit the JVM option, and enter
    -DENABLE_WRITER_BULK_PROCESSING=true
    .
  5. Click
    Save
    .
This update does not apply for mapping tasks configured with SQL ELT optimization using the Snowflake ODBC connection or the Snowflake Data Cloud connection.

0 COMMENTS

We’d like to hear from you!