Hadoop Files V2 Connector

Back Next

Data compression in Hadoop Files V2 sources and targets

You can decompress data when you read data from Hadoop Files V2 and compress the data when you write data to Hadoop Files V2.

Configure the compression format in the

Compression Format

option under the advanced source and target properties.

The following table lists the compression format support for various operations and file formats:

Compression format	Avro File	JSON File	Parquet File	Binary File
None	Yes	Yes	Yes	Yes
Auto	Yes	Yes	Yes	Yes
Bzip2	No	No	No	Yes
Deflate	Yes	No	No	Yes
Gzip	No	No	Yes	Yes
LZO	No	No	Yes	Yes
Snappy	Yes	No	Yes	Yes

You cannot use any compression format for a JSON file in Hadoop Files V2 Sources and Targets.

Watch

Comments

0 COMMENTS

We’d like to hear from you! Log in to comment.