Table of Contents

Search

  1. Preface
  2. Understanding Pipeline Partitioning
  3. Partition Points
  4. Partition Types
  5. Pushdown Optimization
  6. Pushdown Optimization and Transformations
  7. Real-time Processing
  8. Commit Points
  9. Row Error Logging
  10. Workflow Recovery
  11. Stopping and Aborting
  12. Concurrent Workflows
  13. Grid Processing
  14. Load Balancer
  15. Workflow Variables
  16. Parameters and Variables in Sessions
  17. Parameter Files
  18. FastExport
  19. External Loading
  20. FTP
  21. Session Caches
  22. Incremental Aggregation
  23. Session Log Interface
  24. Understanding Buffer Memory
  25. High Precision Data

Advanced Workflow Guide

Advanced Workflow Guide

Rules and Guidelines for Creating Partition Groups

Rules and Guidelines for Creating Partition Groups

The Integration Service uses the following rules and guidelines to create partition groups:
  • The Integration Service limits the number of partition groups to the number of nodes in a grid.
  • When a transformation is partitionable locally, the DTM process forms one partition group for the transformation threads, and runs that group in one DTM process. The following transformations are partitioned locally:
    • Custom transformation configured to partition locally
    • External Procedure transformation
    • Cached Lookup transformation
    • Unsorted Joiner transformation
    • SDK Reader or Writer transformation configured to partition locally


Updated June 25, 2020