Table of Contents

Search

  1. Preface
  2. Introduction to Transformations
  3. Transformation Ports
  4. Transformation Caches
  5. Address Validator Transformation
  6. Aggregator Transformation
  7. Association Transformation
  8. Bad Record Exception Transformation
  9. Case Converter Transformation
  10. Classifier Transformation
  11. Comparison Transformation
  12. Consolidation Transformation
  13. Data Masking Transformation
  14. Data Processor Transformation
  15. Decision Transformation
  16. Duplicate Record Exception Transformation
  17. Expression Transformation
  18. Filter Transformation
  19. Hierarchical to Relational Transformation
  20. Java Transformation
  21. Java Transformation API Reference
  22. Java Expressions
  23. Joiner Transformation
  24. Key Generator Transformation
  25. Labeler Transformation
  26. Lookup Transformation
  27. Lookup Caches
  28. Dynamic Lookup Cache
  29. Match Transformation
  30. Match Transformations in Field Analysis
  31. Match Transformations in Identity Analysis
  32. Normalizer Transformation
  33. Merge Transformation
  34. Parser Transformation
  35. Python Transformation
  36. Rank Transformation
  37. Read Transformation
  38. Relational to Hierarchical Transformation
  39. REST Web Service Consumer Transformation
  40. Router Transformation
  41. Sequence Generator Transformation
  42. Sorter Transformation
  43. SQL Transformation
  44. Standardizer Transformation
  45. Union Transformation
  46. Update Strategy Transformation
  47. Web Service Consumer Transformation
  48. Parsing Web Service SOAP Messages
  49. Generating Web Service SOAP Messages
  50. Weighted Average Transformation
  51. Window Transformation
  52. Write Transformation
  53. Appendix A: Transformation Delimiters

Developer Transformation Guide

Developer Transformation Guide

Transformation Descriptions

Transformation Descriptions

The Developer tool contains common and data quality transformations. Data quality transformations are available in Data Engineering Quality.
The following table describes each transformation:
Transformation
Type
Description
Address Validator
Active or Passive/
Connected
Verifies and enhances the accuracy of postal address records, and adds information that helps users to select the mail recipients and to deliver the mail.
Association
Active/
Connected
Creates links between the duplicate records that a Match transformation assigns to different clusters.
Aggregator
Active/
Connected
Performs aggregate calculations.
Bad Record Exception
Active/
Connected
Identifies records that might contain data errors, and loads the records to tables that an Analyst tool user can review and update.
Case Converter
Passive/
Connected
Standardizes the case of strings.
Classifier
Passive/
Connected
Writes labels that summarize the information in input port fields. Use when the fields contain significant amounts of text.
Comparison
Passive/
Connected
Generates numeric scores that indicate the degree of similarity between pairs of input strings.
Consolidation
Active/
Connected
Creates a consolidated record from records identified as duplicates by the Match transformation.
Data Masking
Passive/
Connected or Unconnected
Replaces sensitive production data with realistic test data for non-production environments.
Data Processor
Active/
Connected
Processes unstructured and semi-structured file formats in a mapping.
Decision
Passive/
Connected
Evaluates conditions in input data and creates output based on the results of those conditions.
Duplicate Record Exception
Active/
Connected
Identifies records that might contain duplicate information, and loads the records to tables that an Analyst tool user can review and update.
Expression
Passive/
Connected
Calculates a value.
Filter
Active/
Connected
Filters data.
Hierarchical to Relational
Active/
Connected
Processes hierarchical input and transforms it into relational output.
Java
Active or Passive/
Connected
Executes user logic coded in Java. The repository stores the byte code for the user logic.
Joiner
Active/
Connected
Joins data from different databases or flat file systems.
Key Generator
Active/
Connected
Assigns records to groups based on data values in a column that you select.
Labeler
Passive/
Connected
Writes labels that describe the characters or strings in an input port field.
Lookup
Active or Passive/
Connected or Unconnected
Look up and return data from a flat file, logical data object, reference table, relational table, view, or synonym.
Match
Active/
Connected
Generates scores that indicate the degrees of similarity between input records.
Merge
Passive/
Connected
Reads the data values from multiple input columns and creates a single output column.
Normalizer
Active/
Connected
Processes source rows that contain multiple-occurring data and returns a target row for each instance of the multiple-occurring data.
Output
Passive/
Connected
Defines mapplet output rows.
Parser
Passive/
Connected
Parses the values on an input port into separate output ports based on the types of information that the values contain.
Rank
Active/
Connected
Limits records to a top or bottom range.
Read
Passive/
Connected
Reads data from a source.
Relational to Hierarchical
Active/
Connected
Processes relational input and transforms it into hierarchical output.
REST Web Service Consumer
Active/
Connected
Connects to a REST web service as a web service client to access or transform data
Router
Active/
Connected
Routes data into multiple transformations based on group conditions.
Sequence Generator
Passive/
Connected
Generates a numeric sequence of values.
Sorter
Active/
Connected
Sorts data based on a sort key.
SQL
Active or Passive/
Connected
Executes SQL queries against a database.
Standardizer
Passive/
Connected
Generates standardized versions of input strings.
Union
Active/
Connected
Merges data from different databases or flat file systems.
Update Strategy
Active/
Connected
Determines whether to insert, delete, update, or reject rows.
Web Service Consumer
Active/
Connected
Connects to a web service as a web service client to access or transform data.
Weighted Average
Passive/
Connected
Reads the match scores that a Match transformation generates for the records in a data set, and calculates an average score for each pair of records. You can apply different weights to the scores that the transformation generates for each pair of records.
Write
Passive/
Connected
Represents a target that the mapping writes data to.

0 COMMENTS

We’d like to hear from you!