Step 1. Enable Data Compression in the Hadoop Connection
Step 1. Enable Data Compression in the Hadoop Connection
Use the Administrator tool or the Developer tool to configure the Hadoop connection to enable data compression on temporary staging tables.
In the Hadoop connection properties, edit the properties to run mappings in a Hadoop cluster.
Select
Temporary Table Compression Codec
.
Choose to select a predefined codec class name or enter a custom codec class name.
To select a predefined codec class name, select a compression library from the list.
To enter a custom codec class name, select custom from the list and enter the codec class name that matches the codec class name in the Hadoop cluster.