Table of Contents

Search

  1. Preface
  2. Understanding Pipeline Partitioning
  3. Partition Points
  4. Partition Types
  5. Pushdown Optimization
  6. Pushdown Optimization and Transformations
  7. Real-time Processing
  8. Commit Points
  9. Row Error Logging
  10. Workflow Recovery
  11. Stopping and Aborting
  12. Concurrent Workflows
  13. Grid Processing
  14. Load Balancer
  15. Workflow Variables
  16. Parameters and Variables in Sessions
  17. Parameter Files
  18. FastExport
  19. External Loading
  20. FTP
  21. Session Caches
  22. Incremental Aggregation
  23. Session Log Interface
  24. Understanding Buffer Memory
  25. High Precision Data

Advanced Workflow Guide

Advanced Workflow Guide

One Input Group

One Input Group

When a single input group Custom transformation is downstream from a multiple input group Custom transformation that does not have a partition point, the Workflow Manager places a pass-through partition point at the closest upstream multiple input group transformation.
For example, consider the following mapping:
In this mapping, two Source Qualifier transformations connect to CT_sort, which contains multiple input groups. CT_sort connects to CT_quartile.
  1. Partition point.
  2. Multiple input groups.
  3. Single input group.
  4. Requires one thread for each partition.
  5. Does not require one thread for each partition.
CT_quartile contains one input group and is downstream from a multiple input group transformation, CT_sort. CT_quartile requires one thread for each partition, but the upstream Custom transformation CT_sort does not. The Workflow Manager creates a partition point at the closest upstream multiple input group transformation, CT_Sort.


Updated June 03, 2019