Table of Contents

Search

  1. Preface
  2. Introduction to Mass Ingestion
  3. Prepare
  4. Create
  5. Deploy
  6. Run
  7. Monitor
  8. Appendix A: infacmd mi Command Reference

Mass Ingestion Guide

Mass Ingestion Guide

Compression Codec

Compression Codec

When you configure a mass ingestion specification to ingest data to an HDFS target directory, you can configure a compression codec to write the ingested data to a compressed file.
You can select one of the following compression options:
  • Gzip
  • Bzip2
  • LZO
  • Snappy
  • Custom
If you specify a custom compression codec, you must specify the fully qualified class name implementing the Hadoop
CompressionCodec
interface.

0 COMMENTS

We’d like to hear from you!