Performance Tuning Guide

Back Next

Flat File Target Optimization

You can improve mapping performance by optimizing flat file targets. You can also push transformation tasks to a command to improve performance.

Consider the following solutions to reduce flat file target bottlenecks:

Push transformation tasks to a command instead of the Data Integration Service.: You can improve mapping performance by pushing transformation tasks to a command instead of the Data Integration Service. You can also use a command to sort or to compress target data. In the Developer tool, configure the Command property in the run-time properties for a flat file target.

On UNIX, use any valid UNIX command or shell script. On Windows, use any valid DOS command or batch file. The flat file writer sends the data to the command instead of a flat file target.

For example, use the following command to generate a compressed file from the target data:
compress -c - > MyTargetFiles/MyCompressedFile.Z

Write to a flat file target that is local to the service process node.: If the Data Integration Service runs on a single node and writes to a flat file target, you can optimize mapping performance by writing to a flat file target that is local to the service process node.