Table of Contents

Search

  1. Preface
  2. Part 1: Getting Started with Snowflake Data Cloud Connector
  3. Part 2: Data Integration with Snowflake Data Cloud Connector
  4. Part 3: SQL ELT with Snowflake Data Cloud Connector
  5. Appendix A: Data type reference
  6. Appendix B: Additional runtime configurations
  7. Appendix C: Upgrading to Snowflake Data Cloud Connector

Snowflake Data Cloud Connector

Snowflake Data Cloud Connector

Step 3. Configure the mapping task

Step 3. Configure the mapping task

After you create a mapping, add the mapping to a mapping task, and configure the advanced properties. Run the associated mapping task to write the changed data to Snowflake.
  1. From the
    Actions
    menu, click
    New Mapping Task
    .
    The
    New Mapping Task
    page appears.
  2. In the
    Definition
    tab, enter the task name and select the configured mapping.
  3. In the
    CDC Runtime
    tab, specify the required properties for the selected CDC source.
    For more information about the
    CDC Runtime
    properties, see the source properties for the selected CDC source.
  4. In the
    Runtime Options
    tab, add the following properties in the
    Advanced Session Properties
    section:
    1. In the
      Commit on End of File
      field, select the value of the property as
      No
      .
    2. In the
      Commit Type
      field, select the value of the property as
      Source
      .
    3. In the
      Recovery Strategy
      field, select the value of the property as
      Resume from last checkpoint
      .
  5. Click
    Save
    Run
    the mapping task.
    Alternatively, you can create a schedule that runs the mapping task on a recurring basis without manual intervention. You can define the schedule to minimize the time between mapping task runs. In
    Monitor
    , you can monitor the status of the logs after you run the task.
To improve performance, specify a higher commit interval for the Maximum Rows Per Commit property in the CDC Runtime page in the mapping task wizard. However, in case of failure, recovery takes more time for a higher commit interval.

0 COMMENTS

We’d like to hear from you!