Table of Contents

Search

  1. Preface
  2. Introduction to Mass Ingestion
  3. Prepare
  4. Create
  5. Deploy
  6. Run
  7. Monitor
  8. Appendix A: infacmd mi Command Reference

Mass Ingestion Guide

Mass Ingestion Guide

Propagate Schema Changes

Propagate Schema Changes

When you ingest data to a Hive target, you can propagate schema changes on the source to accommodate for schema drift in the relational database.
Schema drift occurs when you change the schema of a source table. For example, you might add new columns or change existing columns in the table. It can be a time-intensive task to revise the schemas of the target tables to match the schemas of the source tables before you perform each load of the data.
To accommodate for potential schema drift in the source tables, you can configure incremental loads to propagate schema changes on the source to the target. If the source tables have new columns or changes to existing columns, this option propagates the changes to the target tables.
The following image shows the property that you can use to propagate schema changes:
This image shows the Target page for a mass ingestion specification that ingests data to a Hive target. At the bottom of the page, there is a checkbox next to the property Propagate schema changes on the source.
For more information about propagating schema changes, see the
Informatica PowerExchange for Hive User Guide
. Mass ingestion leverages the APPLYNEWSCHEMA target schema strategy.

0 COMMENTS

We’d like to hear from you!