Data Integration Performance Tuning

Back Next

Allocating memory

For optimal performance, configure the Sorter cache size with a value less than or equal to the amount of available physical RAM on the Secure Agent machine.

Allocate at least 16 MB of physical memory to sort data using the Sorter transformation. The Sorter cache size is set to 16,777,216 bytes by default. If

Data Integration

can't allocate enough memory to sort data, the mapping task fails.

If the amount of incoming data is greater than the amount of Sorter cache size,

Data Integration

temporarily stores data in the Sorter transformation work directory.

Data Integration

requires disk space of at least twice the amount of incoming data when storing data in the work directory. If the amount of incoming data is significantly greater than the Sorter cache size,

Data Integration

may require much more than twice the amount of disk space available to the work directory.

The session log contains the input row count and the size of incoming data for the Sorter transformation. For example, the following message appears when

Data Integration

processes the Sorter transformation:

SORT_40422 End of output from Sorter Transformation [srt_1_Billion_FF]. Processed 999999999 rows (866325637228 input bytes; 868929593344 temp I/O bytes)

In the message, the number of input rows is 999999999 and the size of the input rows is 866325637228.

Rename Saved Search

Table of Contents

Data Integration Performance Tuning

Data Integration Performance Tuning

Allocating memory

Allocating memory