Table of Contents

Search

  1. Preface
  2. Understanding Pipeline Partitioning
  3. Partition Points
  4. Partition Types
  5. Pushdown Optimization
  6. Pushdown Optimization and Transformations
  7. Real-time Processing
  8. Commit Points
  9. Row Error Logging
  10. Workflow Recovery
  11. Stopping and Aborting
  12. Concurrent Workflows
  13. Grid Processing
  14. Load Balancer
  15. Workflow Variables
  16. Parameters and Variables in Sessions
  17. Parameter Files
  18. FastExport
  19. External Loading
  20. FTP
  21. Session Caches
  22. Incremental Aggregation
  23. Session Log Interface
  24. Understanding Buffer Memory
  25. High Precision Data

Advanced Workflow Guide

Advanced Workflow Guide

Rules and Guidelines for Dynamic Partitioning

Rules and Guidelines for Dynamic Partitioning

Use the following rules and guidelines with dynamic partitioning:
  • Dynamic partitioning uses the same connection for each partition.
  • You cannot use dynamic partitioning with XML sources and targets.
  • You cannot use dynamic partitioning with the Debugger.
  • Sessions that use SFTP fail if you enable dynamic partitioning.
  • When you set dynamic partitioning to a value other than disabled, and you manually partition the session on the Mapping tab, you invalidate the session.
  • The session fails if you use a parameter other than $DynamicPartitionCount to set the number of partitions.
  • The following dynamic partitioning configurations cause a session to run with one partition:
    • You override the default cache directory for an Aggregator, Joiner, Lookup, or Rank transformation. The Integration Service partitions a transformation cache directory when the default is $PMCacheDir.
    • You override the Sorter transformation default work directory. The Integration Service partitions the Sorter transformation work directory when the default is $PMTempDir.
    • You use an open-ended range of numbers or date keys with a key range partition type.
    • You use datatypes other than numbers or dates as keys in key range partitioning.
    • You use key range relational target partitioning.
    • You create a user-defined SQL statement or a user-defined source filter.
    • You set dynamic partitioning to the number of nodes in the grid, and the session does not run on a grid.
    • You use pass-through relational source partitioning.
    • You use dynamic partitioning with an Application Source Qualifier.
    • You use SDK or PowerConnect sources and targets with dynamic partitioning.


Updated August 27, 2020