Table of Contents

Search

  1. Preface
  2. Introduction to Mass Ingestion
  3. Prepare
  4. Create
  5. Deploy
  6. Run
  7. Monitor
  8. infacmd mi Command Reference

Mass Ingestion Guide

Mass Ingestion Guide

Configuring an HDFS Target

Configuring an HDFS Target

If the mass ingestion specification ingests data to an HDFS target, configure the HDFS target to specify how you want to ingest data to flat files on HDFS.
  1. Select the target connection.
  2. Optionally, enter the prefix and suffix to add to the target files.
  3. Enter the ingestion directory.
  4. Select the compression format. If you select to use custom compression, enter the compression codec.
  5. Select the delimiter. If you select
    Other
    , enter a custom delimiter.
  6. If you enabled incremental load in the definition of the mass ingestion specification, configure the following incremental load option:
    • Mode. Select
      Append
      or
      Overwrite
      . Default is Append.

0 COMMENTS

We’d like to hear from you!