Table of Contents

Search

  1. Abstract
  2. Supported Versions
  3. Tuning and Sizing Guidelines for Data Engineering Integration (10.4.x)

Tuning and Sizing Guidelines for Data Engineering Integration (10.4.x)

Tuning and Sizing Guidelines for Data Engineering Integration (10.4.x)

Sequence Generator Transformation

Sequence Generator Transformation

To
Maintain Row Order
, the Sequence Generator transformation generates the following types of global and unique sequences. The following image shows where you can configure the
Maintain Row Order
property:
The Sequence Generator transformation generates the following types of sequence numbers:
Global sequence
When you configure the transformation to maintain row order, the mapping runs in a single partition to generate a global unique running sequence. You must run the job in a single partition with only one mapper or reducer. When the Spark engine performs distributed processing it cannot generate numbers in sequential order.
Configure the transformation to maintain row order only if your business needs require a global unique running sequence.
Unique sequence
When you do not configure the transformation to maintain row order, the mapping runs in multiple partitions to efficiently generate unique sequence numbers.
For information about troubleshooting the Sequence Generator transformation, see Troubleshooting Spark Job Failures.

0 COMMENTS

We’d like to hear from you!