Preface
Working with Transformations
- Transformations Overview
- Creating a Transformation
- Configuring Transformations
  - Renaming Transformations
- Transformation Ports
- Multi-Group Transformations
- Working with Expressions
- Local Variables
- Default Values for Ports
- Configuring Tracing Level in Transformations
- Reusable Transformations
Aggregator Transformation
- Aggregator Transformation Overview
- Components of the Aggregator Transformation
  - Configuring Aggregator Transformation Properties
  - Configuring Aggregator Transformation Ports
- Configuring Aggregate Caches
- Aggregate Expressions
- Group By Ports
  - Non-Aggregate Expressions
  - Default Values
- Using Sorted Input
  - Sorted Input Conditions
  - Sorting Data
- Creating an Aggregator Transformation
- Tips for Aggregator Transformations
- Troubleshooting Aggregator Transformations
Custom Transformation
- Custom Transformation Overview
- Creating Custom Transformations
  - Rules and Guidelines for Custom Transformations
  - Custom Transformation Components
- Working with Groups and Ports
- Working with Port Attributes
  - Editing Port Attribute Values
- Custom Transformation Properties
  - Setting the Update Strategy
  - Working with Thread-Specific Procedure Code
- Working with Transaction Control
- Blocking Input Data
- Working with Procedure Properties
- Creating Custom Transformation Procedures
Custom Transformation Functions
- Custom Transformation Functions Overview
  - Working with Handles
- Function Reference
- Working with Rows
  - Rules and Guidelines for Row-Based and Array-Based Data Access Mode
- Generated Functions
- API Functions
- Array-Based API Functions
Data Masking Transformation
- Data Masking transformation
- Masking Properties
  - Locale
  - Masking Types
  - Repeatable Output
  - Seed
  - Mapping Parameters
  - Associated O/P
- Key Masking
  - Masking String Values
  - Masking Numeric Values
  - Masking Datetime Values
- Substitution Masking
  - Dictionaries
  - Storage Tables
    - Encrypting Storage Tables for Substitution Masking
  - Substitution Masking Properties
  - Relational Dictionary
  - Connection Requirements
  - Rules and Guidelines for Substitution Masking
- Dependent Masking
  - Dependent Masking Example
  - Repeatable Dependent Masking
- Random Masking
  - Masking Numeric Values
  - Masking String Values
  - Masking Date Values
- Applying Masking Rules
  - Mask Format
  - Source String Characters
    - Source String Example
  - Result String Replacement Characters
    - Result String Replacement Characters Example
  - Range
  - Blurring
    - Blurring Numeric Values
    - Blurring Date Values
- Expression Masking
  - Repeatable Expression Masking
  - Rules and Guidelines for Expression Masking
- Format Preserving Encryption
- Special Mask Formats
- Social Security Number Masking
  - Social Security Number Format
  - Area Code Requirement
  - Repeatable Social Security Number Masking
- Credit Card Number Masking
- Phone Number Masking
- Email Address Masking
  - Advanced Email Masking
    - Configuration Parameters for an Advanced Email Address Masking Type
    - Expressions for the Advanced Email Address Masking Type
- Social Insurance Number Masking
  - SIN Start Digit
  - Repeatable SIN Numbers
- IP Address Masking
- URL Address Masking
- Default Value File
- Data Masking Transformation Session Properties
- Rules and Guidelines for Data Masking Transformations
Data Masking Examples
- Name and Address Lookup Files
- Substituting Data with the Lookup Transformation
- Masking Data with an Expression Transformation
Expression Transformation
- Expression Transformation Overview
- Expression Transformation Components
- Configuring Ports
  - Calculating Values
- Creating an Expression Transformation
External Procedure Transformation
- External Procedure Transformation Overview
- Configuring External Procedure Transformation Properties
- Developing COM Procedures
- Developing Informatica External Procedures
- Distributing External Procedures
  - Distributing COM Procedures
    - Distributing a COM Visual Basic Procedure
    - Distributing a COM Visual Basic Procedure Manually
  - Distributing Informatica Modules
- Development Notes
- Service Process Variables in Initialization Properties
- External Procedure Interfaces
Filter Transformation
- Filter Transformation Overview
- Filter Transformation Components
  - Configuring Filter Transformation Ports
- Filter Condition
  - Filtering Rows with Null Values
- Steps to Create a Filter Transformation
- Tips for Filter Transformations
HTTP Transformation
- HTTP Transformation Overview
  - Authentication
  - Connecting to the HTTP Server
- Creating an HTTP Transformation
- Configuring the Properties Tab
- Configuring the HTTP Tab
- Examples
Identity Resolution Transformation
- Identity Resolution Transformation Overview
- Create and Configure the Transformation
- Identity Resolution Transformation Tabs
- Groups and Ports
  - Input Groups and Ports
  - Output Groups and Ports
Java Transformation
- Java Transformation Overview
- Using the Java Code Tab
- Configuring Ports
  - Creating Groups and Ports
  - Setting Default Port Values
    - Input and Output Ports
    - Input/Output Ports
- Configuring Java Transformation Properties
  - Working with Transaction Control
    - Transformation Scope
    - Generate Transaction
  - Setting the Update Strategy
- Developing Java Code
- Configuring Java Transformation Settings
- Compiling a Java Transformation
- Fixing Compilation Errors
  - Locating the Source of Compilation Errors
    - Locating Errors in the Code Entry Tabs
    - Locating Errors in the Full Code Window
  - Identifying the Source of Compilation Errors
    - User Code Errors
    - Non-User Code Errors
Java Transformation API Reference
- Java Transformation API Methods Overview
- commit
- failSession
- generateRow
- getInRowType
- getMetadata
- incrementErrorCount
- isNull
- logError
- logInfo
- rollBack
- setNull
- setOutRowType
- storeMetadata
Java Expressions
- Java Expressions Overview
  - Expression Function Types
- Using the Define Expression Dialog Box to Define an Expression
- Working with the Simple Interface
  - invokeJExpression
  - Simple Interface Example
- Working with the Advanced Interface
- JExpression Class API Reference
Java Transformation Example
- Java Transformation Example Overview
- Step 1. Import the Mapping
- Step 2. Create Transformation and Configure Ports
- Step 3. Enter Java Code
- Import Packages Tab
- Helper Code Tab
- On Input Row Tab
- Step 4. Compile the Java Code
- Step 5. Create a Session and Workflow
  - Sample Data
Joiner Transformation
- Joiner Transformation Overview
  - Working with the Joiner Transformation
- Joiner Transformation Properties
- Defining a Join Condition
- Defining the Join Type
- Using Sorted Input
- Joining Data from a Single Source
- Blocking the Source Pipelines
  - Unsorted Joiner Transformation
  - Sorted Joiner Transformation
    - Caching Master Rows
- Working with Transactions
- Creating a Joiner Transformation
- Tips for Joiner Transformations
Lookup Transformation
- Lookup Transformation Overview
- Lookup Source Types
- Connected and Unconnected Lookups
  - Connected Lookups
  - Unconnected Lookups
- Lookup Components
- Lookup Properties
  - Configuring Lookup Properties in a Session
- Lookup Query
- Lookup Condition
- Lookup Caches
- Return Multiple Rows
  - Rules and Guidelines for Returning Multiple Rows
- Configuring Unconnected Lookup Transformations
- Database Deadlock Resilience
- Creating a Lookup Transformation
  - Creating a Reusable Pipeline Lookup Transformation
  - Creating a Non-Reusable Pipeline Lookup Transformation
- Tips for Lookup Transformations
Lookup Caches
- Lookup Caches Overview
  - Cache Comparison
- Building Connected Lookup Caches
  - Sequential Caches
  - Concurrent Caches
- Using a Persistent Lookup Cache
- Working with an Uncached Lookup or Static Cache
- Sharing the Lookup Cache
  - Sharing an Unnamed Lookup Cache
    - Guidelines for Sharing an Unnamed Lookup Cache
  - Sharing a Named Lookup Cache
    - Guidelines for Sharing a Named Lookup Cache
- Tips for Lookup Caches
Dynamic Lookup Cache
- Dynamic Lookup Cache Overview
- Dynamic Lookup Properties
- Lookup Transformation Values
- Dynamic Lookup Cache Updates
  - Insert Else Update
  - Update Else Insert
- Mappings with Dynamic Lookups
- Conditional Dynamic Cache Updates
  - Session Processing
  - Configuring a Conditional Dynamic Cache Lookup
- Dynamic Cache Update with Expression Results
- Synchronizing Cache with the Lookup Source
  - NewLookupRow
  - Configuring Dynamic Cache Synchronization
- Dynamic Lookup Cache Example
- Rules and Guidelines for Dynamic Lookup Caches
Normalizer Transformation
- Normalizer Transformation Overview
- Normalizer Transformation Components
- Normalizer Transformation Generated Keys
  - Storing Generated Key Values
  - Changing the Generated Key Values
- VSAM Normalizer Transformation
- Pipeline Normalizer Transformation
- Using a Normalizer Transformation in a Mapping
  - Generating Key Values
- Troubleshooting Normalizer Transformations
Rank Transformation
- Rank Transformation Overview
- Ports in a Rank Transformation
  - Rank Index
- Defining Groups
- Creating a Rank Transformation
Router Transformation
- Router Transformation Overview
- Working with Groups
- Working with Ports
- Connecting Router Transformations in a Mapping
- Creating a Router Transformation
Sequence Generator Transformation
- Sequence Generator Transformation Overview
- Sequence Generator Ports
  - NEXTVAL Port
    - Create Keys
    - Replace Missing Values
  - CURRVAL
- Sequence Generator Transformation Properties
- Sequence Generator Advanced Properties
  - Reset
- Creating a Sequence Generator Transformation
- Sequence Generator Transformation in a Non-native Environment
  - Sequence Generator Transformation on the Blaze Engine
  - Sequence Generator Transformation on the Spark Engine
Sorter Transformation
- Sorter Transformation Overview
- Sorting Data
- Sorter Transformation Properties
- Creating a Sorter Transformation
Source Qualifier Transformation
- Source Qualifier Transformation Overview
- Source Qualifier Transformation Properties
- Default Query
  - Viewing the Default Query
  - Overriding the Default Query
- Joining Source Data
- Adding an SQL Query
- Entering a User-Defined Join
- Outer Join Support
- Entering a Source Filter
- Using Sorted Ports
- Select Distinct
  - Overriding Select Distinct in the Session
- Adding Pre- and Post-Session SQL Commands
- Creating a Source Qualifier Transformation
  - Creating a Source Qualifier Transformation Manually
  - Configuring Source Qualifier Transformation Options
- Troubleshooting Source Qualifier Transformations
SQL Transformation
- SQL Transformation Overview
- Script Mode
  - Example
  - Rules and Guidelines for Script Mode
- Query Mode
- Connecting to Databases
- Session Processing
- Input Row to Output Row Cardinality
- SQL Transformation Properties
- SQL Statements
- Creating an SQL Transformation
Using the SQL Transformation in a Mapping
- SQL Transformation Example Overview
- Dynamic Update Example
- Dynamic Connection Example
Stored Procedure Transformation
- Stored Procedure Transformation Overview
- Using a Stored Procedure in a Mapping
- Writing a Stored Procedure
  - Sample Stored Procedure
- Creating a Stored Procedure Transformation
- Configuring a Connected Transformation
- Configuring an Unconnected Transformation
  - Calling a Stored Procedure From an Expression
  - Calling a Pre- or Post-Session Stored Procedure
- Error Handling
- Stored Procedure Options
- Expression Rules
- Tips for Stored Procedure Transformations
- Troubleshooting Stored Procedure Transformations
Transaction Control Transformation
- Transaction Control Transformation Overview
- Transaction Control Transformation Properties
  - Properties Tab
  - Example
- Using Transaction Control Transformations in Mappings
  - Sample Transaction Control Mappings with Multiple Targets
- Mapping Guidelines and Validation
- Creating a Transaction Control Transformation
Union Transformation
- Union Transformation Overview
  - Rules and Guidelines for Union Transformations
  - Union Transformation Components
- Working with Groups and Ports
- Creating a Union Transformation
- Using a Union Transformation in a Mapping
Unstructured Data Transformation
- Unstructured Data Transformation Overview
- Configuring the Unstructured Data Option
  - Configuring the Data Transformation Repository Directory
- Data Transformation Service Types
- Unstructured Data Transformation Components
- Unstructured Data Transformation Ports
- Unstructured Data Transformation Service Names
- Relational Hierarchies
  - Exporting the Hierarchy Schema
- Mappings
- Creating an Unstructured Data Transformation
Update Strategy Transformation
- Update Strategy Transformation Overview
  - Setting the Update Strategy
- Flagging Rows Within a Mapping
- Setting the Update Strategy for a Session
  - Specifying an Operation for All Rows
  - Specifying Operations for Individual Target Tables
- Update Strategy Checklist
XML Transformations
- XML Source Qualifier Transformation
- XML Parser Transformation
- XML Generator Transformation

Transformation Guide

10.5
- 10.5.6
- 10.5.1
- 10.4.0

Back Next

Custom Transformation Properties

Properties for the Custom transformation apply to both the procedure and the transformation. Configure the Custom transformation properties on the Properties tab of the Custom transformation.

The following table describes the Custom transformation properties:

Option	Description
Language	Language used for the procedure code. You define the language when you create the Custom transformation. If you need to change the language, create a new Custom transformation.
Module Identifier	Module name. Applies to Custom transformation procedures developed using C or C++. Enter only ASCII characters in this field. You cannot enter multibyte characters. This property is the base name of the DLL or the shared library that contains the procedure. The Designer uses this name to create the C file when you generate the external procedure code.
Function Identifier	Name of the procedure in the module. Applies to Custom transformation procedures developed using C. Enter only ASCII characters in this field. You cannot enter multibyte characters. The Designer uses this name to create the C file where you enter the procedure code.
Class Name	Class name of the Custom transformation procedure. Applies to Custom transformation procedures developed using C++ or Java. Enter only ASCII characters in this field. You cannot enter multibyte characters.
Runtime Location	Location that contains the DLL or shared library. Default is $PMExtProcDir. Enter a path relative to the Integration Service node that runs the Custom transformation session. If this property is blank, the Integration Service uses the environment variable defined on the Integration Service node to locate the DLL or shared library. You must copy all DLLs or shared libraries to the runtime location or to the environment variable defined on the Integration Service node. The Integration Service fails to load the procedure when it cannot locate the DLL, shared library, or a referenced file.
Tracing Level	Amount of detail displayed in the session log for this transformation. Default is Normal.
Is Partitionable	Indicates if you can create multiple partitions in a pipeline that uses this transformation: No. The transformation cannot be partitioned. The transformation and other transformations in the same pipeline are limited to one partition. Locally. The transformation can be partitioned, but the Integration Service must run all partitions in the pipeline on the same node. Choose Local when different partitions of the Custom transformation must share objects in memory. Across Grid. The transformation can be partitioned, and the Integration Service can distribute each partition to different nodes. Default is No.
Inputs Must Block	Indicates if the procedure associated with the transformation must be able to block incoming data. Default is enabled.
Is Active	Indicates if this transformation is an active or passive transformation. You cannot change this property after you create the Custom transformation. If you need to change this property, create a new Custom transformation and select the correct property value.
Update Strategy Transformation	Indicates if this transformation defines the update strategy for output rows. Default is disabled. You can enable this for active Custom transformations.
Transformation Scope	Indicates how the Integration Service applies the transformation logic to incoming data: Row Transaction All Input When the transformation is passive, this property is always Row. When the transformation is active, this property is All Input by default.
Generate Transaction	Indicates if this transformation can generate transactions. When a Custom transformation generates transactions, it generates transactions for all output groups. Default is disabled. You can only enable this for active Custom transformations.
Output is Repeatable	Indicates if the order of the output data is consistent between session runs. Never. The order of the output data is inconsistent between session runs. This is the default for active transformations. Based On Input Order. The output order is consistent between session runs when the input data order is consistent between session runs. This is the default for passive transformations. Always. The order of the output data is consistent between session runs even if the order of the input data is inconsistent between session runs.
Requires Single Thread Per Partition	Indicates if the Integration Service processes each partition at the procedure with one thread. When you enable this option, the procedure code can use thread-specific operations. Default is enabled.
Output is Deterministic	Indicates whether the transformation generates consistent output data between session runs. Enable this property to perform recovery on sessions that use this transformation.

If you configure a transformation as repeatable and deterministic, it is your responsibility to ensure that the data is repeatable and deterministic. If you try to recover a session with transformations that do not produce the same data between the session and the recovery, the recovery process can result in corrupted data.

Custom Transformation

Setting the Update Strategy

Working with Thread-Specific Procedure Code

Download Guide

Watch

Comments

Communities

Knowledge Base

Success Portal