Table of Contents

Search

  1. Preface
  2. Introduction to Mass Ingestion
  3. Prepare
  4. Create
  5. Deploy
  6. Run
  7. Monitor
  8. infacmd mi Command Reference

Mass Ingestion Guide

Mass Ingestion Guide

Incremental Load Options

Incremental Load Options

If you enable incremental load in the definition of the mass ingestion specification, you must configure incremental load options for the target.
The incremental load options for the target include an incremental mode. The Spark engine uses the incremental mode to determine how to load incremental data to the target.
If you ingest data to a Hive target, you can also configure the incremental load options to propagate schema changes on the source. Propagating schema changes accommodates for schema drift in the relational database, such as new columns that have been added to the source tables.

0 COMMENTS

We’d like to hear from you!