Table of Contents

Search

  1. Preface
  2. Transformations
  3. Source transformation
  4. Target transformation
  5. Aggregator transformation
  6. Cleanse transformation
  7. Data Masking transformation
  8. Data Services transformation
  9. Deduplicate transformation
  10. Expression transformation
  11. Filter transformation
  12. Hierarchy Builder transformation
  13. Hierarchy Parser transformation
  14. Hierarchy Processor transformation
  15. Input transformation
  16. Java transformation
  17. Java transformation API reference
  18. Joiner transformation
  19. Labeler transformation
  20. Lookup transformation
  21. Machine Learning transformation
  22. Mapplet transformation
  23. Normalizer transformation
  24. Output transformation
  25. Parse transformation
  26. Python transformation
  27. Rank transformation
  28. Router transformation
  29. Rule Specification transformation
  30. Sequence Generator transformation
  31. Sorter transformation
  32. SQL transformation
  33. Structure Parser transformation
  34. Transaction Control transformation
  35. Union transformation
  36. Velocity transformation
  37. Verifier transformation
  38. Web Services transformation

Transformations

Transformations

Transformation types

Transformation types

After you add a transformation to a mapping, you can define transformation details. Each transformation type has a unique set of options that you can configure.
The following table provides a brief description of each transformation:
Transformation
Description
Source
Reads data from a source.
Target
Writes data to a target.
Aggregator
An active transformation that performs aggregate calculations on groups of data.
Cleanse
A passive transformation that adds a cleanse asset that you created in
Data Quality
to a mapping or mapplet. Use a cleanse asset to standardize the form and content of your data.
Data Masking
A passive transformation that masks sensitive data as realistic test data for nonproduction environments.
Data Services
An active transformation that invokes data services from the data services repository, including industry-standard services, such as HL7 and HIPAA, and customized services.
Deduplicate
An active transformation that adds a deduplicate asset that you created in
Data Quality
to a mapping or mapplet. Use a deduplicate asset to find instances of duplicate identities in a data set and optionally to consolidate the duplicates into a single record.
Expression
A passive transformation that performs calculations on individual rows of data.
Filter
An active transformation that filters data from the data flow.
Hierarchy Builder
An active transformation that converts relational input into hierarchical output.
Hierarchy Parser
A passive transformation that converts hierarchical input into relational output.
Hierarchy Processor
An active transformation that converts hierarchical input into relational output, or relational input into hierarchical output, or hierarchical output into hierarchical output of a different schema, or hierarchical input into denormalized flattened output.
Input
A passive transformation that passes data into a mapplet. Can be used in a mapplet, but not in a mapping.
Java
Executes user logic coded in Java.
Can be active or passive.
Joiner
An active transformation that joins data from two sources.
Labeler
A passive transformation that adds a labeler asset that you created in
Data Quality
to a mapping or mapplet. Use a labeler asset to identify the types of information in an input field and to assign labels for each type to the data.
Lookup
Looks up data from a lookup object. Defines the lookup object and lookup connection. Also defines the lookup condition and the return values.
A passive lookup transformation returns one row. An active lookup transformation returns more than one row.
Machine Learning
Runs a machine learning model and returns predictions to the mapping.
Mapplet
Inserts a mapplet into a mapping or another mapplet. A mapplet contains transformation logic that you can create and use to transform data before it is loaded into the target.
Can be active or passive based on the transformation logic in the mapplet.
Normalizer
An active transformation that processes data with multiple-occurring fields and returns a row for each instance of the multiple-occurring data.
Output
A passive transformation that passes data from a mapplet to a downstream transformation. Can be used in a mapplet, but not in a mapping.
Parse
A passive transformation that adds a parse asset that you created in
Data Quality
to a mapping or mapplet. Use a parse asset to parse the words or strings in an input field into one or more discrete output fields based on the types of information that the words or strings contain.
Python
Runs Python code that defines transformation functionality. Can be active or passive.
Rank
An active transformation that limits records to a top or bottom range.
Router
An active transformation that you can use to apply a condition to incoming data.
Rule Specification
A passive transformation that adds a rule specification asset that you created in
Data Quality
to a mapping or mapplet. Use a rule specification asset to apply the data requirements of a business rule to a data set.
Sequence Generator
A passive transformation that generates a sequence of values.
Sorter
A passive transformation that sorts data in ascending or descending order, according to a specified sort condition.
SQL
Calls a stored procedure or function or executes a query against a database.
Passive when it calls a stored procedure or function. Can be active or passive when it processes a query.
Structure Parser
A passive transformation that analyzes unstructured data from a flat file source and writes the data in a structured format.
Transaction Control
An active transformation that commits or rolls back sets of rows during a mapping run.
Union
An active transformation that merges data from multiple input groups into a single output group.
Velocity
A passive transformation that executes a Velocity script to convert JSON or XML hierarchal input from one format to another without flattening the data.
Verifier
A passive transformation that adds a verifier asset that you created in
Data Quality
to a mapping or mapplet. Use a verifier asset to verify and enhance postal address data.
Web Services
An active transformation that connects to a web service as a web service client to access, transform, or deliver data.

0 COMMENTS

We’d like to hear from you!