Table of Contents

Search

  1. Preface
  2. Understanding Pipeline Partitioning
  3. Partition Points
  4. Partition Types
  5. Pushdown Optimization
  6. Pushdown Optimization and Transformations
  7. Real-time Processing
  8. Commit Points
  9. Row Error Logging
  10. Workflow Recovery
  11. Stopping and Aborting
  12. Concurrent Workflows
  13. Grid Processing
  14. Load Balancer
  15. Workflow Variables
  16. Parameters and Variables in Sessions
  17. Parameter Files
  18. FastExport
  19. External Loading
  20. FTP
  21. Session Caches
  22. Incremental Aggregation
  23. Session Log Interface
  24. Understanding Buffer Memory
  25. High Precision Data

Advanced Workflow Guide

Advanced Workflow Guide

Configuring Partitioning

Configuring Partitioning

When you create or edit a session, you can change the partitioning for each pipeline in a mapping. If the mapping contains multiple pipelines, you can specify multiple partitions in some pipelines and single partitions in others. You update partitioning information using the Partitions view on the Mapping tab of session properties. You can configure partitions for non-reusable sessions in the Workflow Designer and for reusable sessions in the Task Developer.
Add, delete, or edit partition points on the Partitions view of session properties. If you add a key range partition point, you can define the keys in each range.
The following table lists the configuration options for the Partitions view on the Mapping tab:
Partitions View Option
Description
Add Partition Point
Click to add a new partition point. When you add a partition point, the transformation name appears under the Partition Points node.
Delete Partition Point
Click to delete the selected partition point.
You cannot delete certain partition points.
Edit Partition Point
Click to edit the selected partition point. This opens the Edit Partition Point dialog box.
Key Range
Displays the key and key ranges for the partition point, depending on the partition type.
For key range partitioning, specify the key ranges.
For hash user keys partitioning, this field displays the partition key.
The Workflow Manager does not display this area for other partition types.
Edit Keys
Click to add or remove the partition key for key range or hash user keys partitioning. You cannot create a partition key for hash auto-keys, round-robin, or pass-through partitioning.

0 COMMENTS

We’d like to hear from you!