Table of Contents

Search

  1. Preface
  2. Part 1: Introduction to Amazon Redshift connectors
  3. Part 2: Data Integration with Amazon Redshift V2 Connector
  4. Part 3: Data Integration with Amazon Redshift Connector

Amazon Redshift Connectors

Amazon Redshift Connectors

Mapping task with Oracle CDC sources example

Mapping
task with Oracle CDC sources example

Your organization needs to replicate real-time changed data from a mission-critical Oracle production system to minimize intrusive, non-critical work, such as offline reporting or analytical operations system. You can use Amazon Redshift V2 Connector to capture changed data from the Oracle CDC source and write the changed data to an Amazon Redshift target table. Add the Oracle CDC sources in mappings, and then run the associated mapping tasks to write the changed data to the target.
  1. In
    Data Integration
    , click
    New
    Mapping
    Create
    .
    The
    New Mapping
    dialog box appears.
  2. Enter a name and description for the mapping.
  3. On the Source transformation, specify a name and description in the general properties.
  4. On the
    Source
    tab, select the configured Oracle CDC connection and specify the required source properties.
  5. On the Target transformation, specify a name and description in the general properties.
  6. On the
    Target
    tab, perform the following steps to configure the target properties:
    1. In the
      Connection
      field, select the Amazon Redshift V2 connection.
    2. In the
      Target Type
      field, select the type of the target object.
    3. In the
      Object
      field, select the required target object.
    4. In the
      Operation
      field, select
      Data Driven
      to properly handle insert, update, and delete records from the source.
    5. In the
      Data Driven Condition
      field, leave the field empty.
    6. In the
      Advanced Properties
      section, provide the values of the required target properties. You must select the
      Preserve record order on write
      check box and enter the value of the
      Recovery Schema Name
      property.
  7. On the
    Field Mapping
    tab, map the incoming fields to the target fields. You can manually map an incoming field to a target field or automatically map fields based on the field names.
  8. In the
    Actions
    menu, click
    New Mapping Task
    .
    The
    New Mapping Task
    page appears.
  9. On the
    Definition
    tab, enter the task name and select the configured mapping.
  10. On the
    CDC Runtime
    tab, specify the required properties.
    For more information about the
    CDC Runtime
    properties, see the help for Oracle CDC Connector.
  11. On the
    Runtime Options
    tab, specify the following properties in the
    Advanced Session Properties
    section:
    1. Select
      Commit on End of File
      from the menu, and keep the property disabled.
    2. Select the
      Commit Type
      field as
      Source
      .
    3. Select
      Recovery Strategy
      and set
      Resume from last checkpoint
      as the value of the property.
  12. Click
    Save
    Run
    the mapping.
    Alternatively, you can create a schedule that runs the mapping task on a recurring basis without manual intervention. You can define the schedule to minimize the time between mapping task runs.
In
Monitor
, you can monitor the status of the logs after you run the task.

0 COMMENTS

We’d like to hear from you!