Table of Contents

Search

  1. Version 10.1.1
  2. Version 10.1
  3. Version 10.0
  4. Version 9.6.1
  5. Version 9.6.0

Partitioned Mappings

Effective in version 10.0, Informatica has the following new features for partitioned mappings:
Partitioned transformations
Additional transformations support partitioning. When a mapping enabled for partitioning contains the following transformations, the Data Integration Service can use multiple threads to transform the data:
  • Address Validator
  • Case Converter
  • Classifier
  • Comparison
  • Data Masking
  • Data Processor
  • Decision
  • Key Generator
  • Labeler
  • Match, when configured for identity match analysis
  • Merge
  • Normalizer
  • Parser
  • Sequence Generator
  • Sorter
  • Standardizer
  • Weighted Average
Cache partitioning
For an Aggregator, Joiner, or Rank transformation, you can configure multiple cache directories to optimize performance during cache partitioning for the transformation. You can use the default CacheDir system parameter value if an administrator configured multiple cache directories for the Data Integration Service. Or, you can override the default CacheDir system parameter value to configure multiple cache directories specific to the transformation.
For a Sorter transformation, you can configure multiple work directories to optimize performance during cache partitioning for the transformation. You can use the default TempDir system parameter value if an administrator configured multiple temporary directories for the Data Integration Service. Or, you can override the default TempDir system parameter value to configure multiple directories specific to the transformation.
Mappings that order data
The Data Integration Service can create partitions for a mapping that establishes a sort order. You can establish sort order in a mapping with a sorted flat file source, a sorted relational source, or a Sorter transformation. When the Data Integration Service adds a partition point to a mapping, it might redistribute data and lose the order established earlier in the mapping. To maintain order in a partitioned mapping, you must specify that Expression, Java, Sequence Generator, SQL, and Write transformations maintain the row order in the transformation advanced properties.
Partitioned flat file targets
To optimize performance when multiple threads write to a flat file target, you can configure multiple output file directories for a flat file data object. You can use the default TargetDir system parameter value if an administrator has configured multiple target directories for the Data Integration Service. Or, you can override the default TargetDir system parameter value to configure multiple output file directories specific to the flat file data object.
Suggested parallelism value for transformations
If you override the maximum parallelism for a mapping, you can define a suggested parallelism value for a specific transformation. The Data Integration Service uses the suggested parallelism value for the number of threads for that transformation pipeline stage as long as the transformation can be partitioned. You can define a suggested parallelism value that is less than the maximum parallelism value defined for the mapping or the Data Integration Service. You might want to define a suggested parallelism value to optimize performance for a transformation that contains many ports or performs complicated calculations.
For more information about partitioned mappings, see the "Partitioned Mappings" chapter in the
Informatica 10.0 Developer Mapping Guide
.


Updated April 09, 2019