PowerExchange for Vertica User Guide for PowerCenter

PowerExchange for Vertica User Guide for PowerCenter

Staging File and Compression

Staging File and Compression

When you write large volumes of data to a Vertica target in bulk mode, you can configure the session to create a staging file. You can also choose to compress the data to improve the session performance.
If you configure the session to create a staging file, the PowerCenter Integration Service writes the data to the staging file and then runs the copy command. The copy command reads the data from the staging file and writes the data to the Vertica target.
On UNIX operating systems, when you enable file staging, you can also choose to compress the data in a GZIP format. By compressing the data, you can reduce the size of data that is transferred over the network and improve session performance.
You can specify the compression factor to determine the level to which the data must be compressed. You can enter a value in the range of 1 to 9.
A value of 1 indicates that the PowerCenter Integration Service takes minimal time to compress the data, but the data compression level is low. A value of 9 indicates that the PowerCenter Integration Service takes maximal time to compress the data, but the data compression level is high in this case. For more information about configuring the data compression factor, see the GNU operating system documentation.

0 COMMENTS

We’d like to hear from you!