Table of Contents

Search

  1. Preface
  2. Mappings
  3. Mapping tutorial
  4. Parameters
  5. CLAIRE recommendations
  6. Data catalog discovery
  7. Visio templates

Mappings

Mappings

Mappings in advanced mode

Mappings in advanced mode

Create a mapping in advanced mode when you want to process multilevel hierarchical data, embedded code snippets, and workloads at any scale. The Mapping Designer updates the mapping canvas to include the transformations and functions that enable advanced functionality.
A mapping in advanced mode can perform the following types of complex processing:
  • Read hierarchical or relational input and convert it to relational, hierarchical, or flattened denormalized output using the Hierarchy Processor transformation.
  • Embed code snippets in a mapping using the Python and Java transformations.
  • Pass data to a machine learning model using the Machine Learning transformation.
  • Reprocess incrementally-loaded source files to create a snapshot of the data from a specified time interval, to debug and discover the source of bad data in your target, and to restore deleted data.
  • Use a code task API to run hand-coded Scala jobs.
  • Use native NoSQL connectors, such as MongoDB, DynamoDB, and CosmosDB, to connect to databases without using third-party drivers.
  • Process data using any connector.
A mapping in advanced mode requires an
advanced cluster
to run mapping logic. When you start running mappings in advanced mode,
Data Integration
can automatically create a local
advanced cluster
for you to use.
To enable local clusters, contact your system administrator to update the Secure Agent configuration. For more information, see Prepare for local clusters in the Administrator help.
Because an
advanced cluster
is required, the mapping must run in one of the following types of runtime environments:
  • A Secure Agent group with one Secure Agent. The Secure Agent must be installed on Linux.
  • A serverless runtime environment.

0 COMMENTS

We’d like to hear from you!