Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Ask INFA.

Table of Contents

Search

  1. Preface
  2. Transformations
  3. Source transformation
  4. Target transformation
  5. Access Policy transformation
  6. Aggregator transformation
  7. B2B transformation
  8. Chunking transformation
  9. Cleanse transformation
  10. Data Masking transformation
  11. Data Services transformation
  12. Deduplicate transformation
  13. Expression transformation
  14. Filter transformation
  15. Hierarchy Builder transformation
  16. Hierarchy Parser transformation
  17. Hierarchy Processor transformation
  18. Input transformation
  19. Java transformation
  20. Java transformation API reference
  21. Joiner transformation
  22. Labeler transformation
  23. Lookup transformation
  24. Machine Learning transformation
  25. Mapplet transformation
  26. Normalizer transformation
  27. Output transformation
  28. Parse transformation
  29. Python transformation
  30. Rank transformation
  31. Router transformation
  32. Rule Specification transformation
  33. Sequence transformation
  34. Sorter transformation
  35. SQL transformation
  36. Structure Parser transformation
  37. Transaction Control transformation
  38. Union transformation
  39. Vector Embedding transformation
  40. Velocity transformation
  41. Verifier transformation
  42. Web Services transformation

Transformations

Transformations

Transformation types

Transformation types

After you add a transformation to a mapping, you can define transformation details. Each transformation type has a unique set of options that you can configure.
The following table provides a brief description of each transformation:
Transformation
Description
Source
Reads data from a source.
Target
Writes data to a target.
Access Policy
A passive transformation that applies access policies created in
Data Access Management
.
Aggregator
An active transformation that performs aggregate calculations on groups of data.
Chunking
An active transformation that splits large pieces of text into smaller segments, or chunks, to increase the content's relevance.
Cleanse
A passive transformation that adds a cleanse asset that you created in
Data Quality
to a mapping or mapplet. Use a cleanse asset to standardize the form and content of your data.
Data Masking
A passive transformation that masks sensitive data as realistic test data for nonproduction environments.
Data Services
An active transformation that invokes data services from the data services repository, including industry-standard services, such as HL7 and HIPAA, and customized services.
Deduplicate
An active transformation that adds a deduplicate asset that you created in
Data Quality
to a mapping or mapplet. Use a deduplicate asset to find instances of duplicate identities in a data set and optionally to consolidate the duplicates into a single record.
Expression
A passive transformation that performs calculations on individual rows of data.
Filter
An active transformation that filters data from the data flow.
Hierarchy Builder
An active transformation that converts relational input into hierarchical output.
Hierarchy Parser
A passive transformation that converts hierarchical input into relational output.
Hierarchy Processor
An active transformation that converts hierarchical input into relational output, or relational input into hierarchical output, or hierarchical output into hierarchical output of a different schema, or hierarchical input into denormalized flattened output.
Input
A passive transformation that passes data into a mapplet. Can be used in a mapplet, but not in a mapping.
Java
Executes user logic coded in Java.
Can be active or passive.
Joiner
An active transformation that joins data from two sources.
Labeler
A passive transformation that adds a labeler asset that you created in
Data Quality
to a mapping or mapplet. Use a labeler asset to identify the types of information in an input field and to assign labels for each type to the data.
Lookup
Looks up data from a lookup object. Defines the lookup object and lookup connection. Also defines the lookup condition and the return values.
A passive lookup transformation returns one row. An active lookup transformation returns more than one row.
Machine Learning
Runs a machine learning model and returns predictions to the mapping.
Mapplet
Inserts a mapplet into a mapping or another mapplet. A mapplet contains transformation logic that you can create and use to transform data before it is loaded into the target.
Can be active or passive based on the transformation logic in the mapplet.
Normalizer
An active transformation that processes data with multiple-occurring fields and returns a row for each instance of the multiple-occurring data.
Output
A passive transformation that passes data from a mapplet to a downstream transformation. Can be used in a mapplet, but not in a mapping.
Parse
A passive transformation that adds a parse asset that you created in
Data Quality
to a mapping or mapplet. Use a parse asset to parse the words or strings in an input field into one or more discrete output fields based on the types of information that the words or strings contain.
Python
Runs Python code that defines transformation functionality. Can be active or passive.
Rank
An active transformation that limits records to a top or bottom range.
Router
An active transformation that you can use to apply a condition to incoming data.
Rule Specification
A passive transformation that adds a rule specification asset that you created in
Data Quality
to a mapping or mapplet. Use a rule specification asset to apply the data requirements of a business rule to a data set.
Sequence
A passive transformation that generates a sequence of values.
Sorter
A passive transformation that sorts data in ascending or descending order, according to a specified sort condition.
SQL
Calls a stored procedure or function or executes a query against a database.
Passive when it calls a stored procedure or function. Can be active or passive when it processes a query.
Structure Parser
A passive transformation that analyzes unstructured data from a flat file source and writes the data in a structured format.
Transaction Control
An active transformation that commits or rolls back sets of rows during a mapping run.
Union
An active transformation that merges data from multiple input groups into a single output group.
Vector Embedding
A passive transformation that generates vector embeddings for input text, capturing the semantic meaning of the text in a vector format.
Velocity
A passive transformation that executes a Velocity script to convert JSON or XML hierarchal input from one format to another without flattening the data.
Verifier
A passive transformation that adds a verifier asset that you created in
Data Quality
to a mapping or mapplet. Use a verifier asset to verify and enhance postal address data.
Web Services
An active transformation that connects to a web service as a web service client to access, transform, or deliver data.

0 COMMENTS

We’d like to hear from you!