Table of Contents

Search

  1. Preface
  2. Introduction to Mass Ingestion
  3. Prepare
  4. Create
  5. Deploy
  6. Run
  7. Monitor
  8. infacmd mi Command Reference

Mass Ingestion Guide

Mass Ingestion Guide

Configuring a Hive Target

Configuring a Hive Target

If the mass ingestion specification ingests data to a Hive target, configure the Hive target to specify how you want to ingest data to the target tables.
  1. Select the target connection.
  2. Enter the target schema.
  3. Optionally, enter the prefix and suffix to add to the target tables.
  4. Choose one of the following options:
    • Select
      Hive Options
      .
      1. Select the storage format. Default is Text.
      2. If the target is an external Hive target, select
        External Table
        and enter the external location.
    • Select
      DDL Query
      and enter a custom DDL query.
  5. If you enabled incremental load in the definition of the mass ingestion specification, configure the following incremental load options:
    • Mode. Select
      Append
      or
      Overwrite
      . Default is Append.
    • Propagate schema changes on the source. Select this option if you expect to update the columns in the source tables or add new columns to the source tables.

0 COMMENTS

We’d like to hear from you!