Data Integration Performance Tuning

Back Next

Buffer memory

When

Data Integration

initializes a task run, it allocates blocks of memory to hold source and target data.

Data Integration

allocates at least two blocks for each source and target partition. Mapping tasks that use a large number of sources and targets might require additional memory blocks. If

Data Integration

can't allocate enough memory blocks to hold the data, the task fails.

You can configure the amount of buffer memory, or you can configure

Data Integration

to calculate buffer settings at run time.

To increase the number of available memory blocks, adjust the following mapping task properties:

DTM Buffer Size

. Increase the DTM buffer size advanced session property in the mapping task.

Buffer Block Size

. Decrease the buffer block size advanced session property in the mapping task.

If data partitioning is enabled, the DTM buffer size is the total size of all memory buffer pools allocated to all partitions. For a task that contains n
partitions, set the DTM Buffer Size to at least n
times the value for the task with one partition.

Eliminating mapping task bottlenecks

Increasing DTM buffer size

Optimizing the buffer block size

Download Guide

Watch

Comments

Communities

Knowledge Base

Success Portal