Increasing Performance for PowerCenter Sessions that Use Partitions

Increasing Performance for PowerCenter Sessions that Use Partitions

Number of Partitions Tuning

Number of Partitions Tuning

The number of CPUs in a session with multiple partitions must be high enough to process the required number of threads and amount of data. If you increase the number of partitions and session performance decreases, you may need to delete some of the partitions.
Increasing the number of partitions or partition points increases the number of threads. Therefore, increasing the number of partitions or partition points also increases the load on the node. If the node contains enough CPU bandwidth, processing rows of data in a session concurrently can increase session performance. However, if you create a large number of partitions or partition points in a session that processes a large amount of data, you can overload the system.
Check the number of CPUs available in a system before running a session with multiple partitions. A simple session that runs in two partitions typically requires twice the amount of CPU than when the session runs in a single partition. If the number of available CPUs is too low to achieve the desired session performance, you may need to adjust the session parameters. Reduce the number of partitions in a session when the number of CPUs is insufficient.

0 COMMENTS

We’d like to hear from you!