, the Sequence Generator transformation generates the following types of global and unique sequences. The following image shows where you can configure the
Maintain Row Order
property:
The Sequence Generator transformation generates the following types of sequence numbers:
Global sequence
When you configure the transformation to maintain row order, the mapping runs in a single partition to generate a global unique running sequence. You must run the job in a single partition with only one mapper or reducer. When the Spark engine performs distributed processing it cannot generate numbers in sequential order.
Configure the transformation to maintain row order only if your business needs require a global unique running sequence.
Unique sequence
When you do not configure the transformation to maintain row order, the mapping runs in multiple partitions to efficiently generate unique sequence numbers.