Data Engineering Streaming 10.2 HotFix 2
- Data Engineering Streaming 10.2 HotFix 2
- All Products
Transformation
| Rules and Guidelines
|
---|---|
Aggregator
| Mapping validation fails in the following situations:
|
Expression
| Mapping validation fails in the following situations:
If an expression results in numerical errors, such as division by zero or SQRT of a negative number, it returns an infinite or an NaN value. In the native environment, the expression returns null values and the rows do not appear in the output.
|
Filter
| Supported without restrictions.
|
Java
| The following restrictions apply to the Java transformation:
|
Joiner
| Mapping validation fails in the following situations:
|
Lookup
| Use a Lookup transformation to look up data in a flat file, HDFS, Hive, or Sqoop.
Mapping validation fails in the following situations:
The mapping fails in the following situations:
You cannot use a float data type to look up data in a Hive table as comparing equality of floating point numbers is unsafe.
When you configure the transformation to return the first, last, or any value on multiple matches, the Data Integration Service returns any value.
To use a Lookup transformation on Sqoop in a Cloudera distribution, perform the following configuration:
Informatica recommends that you select the
Ignore null values that match property in Lookup transformation advanced properties to avoid cross join of DataFrames.
|
Rank
| Supports only case sensitive string comparison.
|
Router
| Supported without restrictions.
|
Sorter
| To use the Sorter transformation in a Streaming mapping, configure the following properties:
Mapping validation fails in the following situations:
The Data Integration Service logs a warning and ignores the Sorter transformation in the following situations:
The Data Integration Service treats null values as high even if you configure the transformation to treat null values as low.
|
Union
| Supported without restrictions.
|
Window
| Supported without restrictions.
See the Window Transformation chapter in this guide for more information.
|
Transformations not listed in this table are not supported. |
Updated April 14, 2019