MySQL CDC Connector

MySQL CDC Connector

Mapping configuration

Mapping configuration

You must configure a mapping that contains a Source transformation for a MySQL CDC source and map it to a Target transformation.
To begin creating a mapping in Data Integration, click
New
>
Mappings
>
Mapping
and then click
Create
.
A mapping must contain at least one Source transformation mapped to one Target transformation. Alternatively, a mapping can contain multiple MySQL CDC sources and multiple targets. For example, you can define multiple one-to-one mappings, map one source to multiple targets, or map multiple sources to one target. To map multiple sources to the same target, you can create multiple one-to-one mappings that map each source separately to the same target. In this case, each source must have a different primary key value.
If you include multiple CDC sources in a mapping, all of the Source transformations must use the same MySQL CDC connection, which connects to the same PowerExchange Listener and source location.
A mapping can also contain other transformation types, such as a Joiner transformation or Lookup transformation, as needed. If you include a Lookup transformation, make sure that you select either the
Lookup Source is Static
or
Lookup Cache Persistent
advanced property for the transformation. Otherwise, any associated mapping task for which the
Recovery Strategy
advanced session property is set to
Resume from last checkpoint
, as recommended, will fail.
When you define a Source transformation in a mapping, you must specify a name for the transformation, a MySQL CDC connection that can connect to the PowerExchange Listener on the PowerExchange Logger system, the source type, and the extraction map for a MySQL source object. You can also set some additional source properties. The PWX CDC Metadata Adapter retrieves metadata for the source table from the PowerExchange-generated extraction map, including the field definitions.
When you define a Target transformation, specify a name for the transformation, a connection to the target, the target type, and the operation type of
Data Driven
. In the user's environment, the target can reside on premises or in a cloud. If you do not want to send all of the incoming fields to the target, you can define one or more exclusion field rules. As part of configuring the target, you must also map the incoming fields to the target fields. You can map fields automatically based on the field names or map them manually.
Instead of selecting specific connections and objects in the Source and Target transformations, you can define a parameter for the connection, the source or target object, or both. You then must enter a specific connection or object in the associated mapping tasks. If you want to use a parameter for the source or target connection, you must perform one of the following actions before the mapping can be successfully validated:
  • Set the
    Source Type
    or
    Target Type
    field to
    Parameter
    and then enter a parameter for the source or target object in the
    Parameter
    field. On the
    Field Mapping
    tab of the Target transformation, you must set the map option to
    Automatic
    for the mapping to be validated.
  • If you want to use a specific source or target object with a connection parameter, first select a specific connection, set the
    Source Type
    or
    Target Type
    field to
    Single Object
    , select a source or target object in the
    Object
    field, validate the mapping, and then enter the connection parameter.
    If you want to validate the source-to-target field mappings, map the fields in the Target transformation before validating the mapping. After the mapping is confirmed as valid, enter connection parameters.
You can also completely or partially parameterize field mappings, and then define specific mappings in the mapping tasks.

0 COMMENTS

We’d like to hear from you!