Table of Contents

Search

  1. Preface
  2. Introduction to Mass Ingestion
  3. Prepare
  4. Create
  5. Deploy
  6. Run
  7. Monitor
  8. infacmd mi Command Reference

Mass Ingestion Guide

Mass Ingestion Guide

Creating a Mass Ingestion Specification

Creating a Mass Ingestion Specification

Create a mass ingestion specification in the Mass Ingestion tool.
  1. In the Mass Ingestion tool, click
    New
    to create a new mass ingestion specification.
    The
    Definition
    page for a new mass ingestion specification appears.
  2. On the
    Definition
    page, configure the definition for the mass ingestion specification.
  3. Click
    Next
    .
  4. On the
    Source
    page, configure the source database and the source tables that you want to ingest.
  5. Click
    Next
    .
  6. On the
    Target
    page, configure the Hive or HDFS target.
  7. Click
    Next
    .
  8. On the
    Mass Transformations
    page, configure the parameters that you want to apply to all source tables.
  9. Click
    Next
    .
  10. On the
    Transformation Override
    page, edit the parameters for specific tables.
    If you need to enter a column or a regular expression, enter the column name or the regular expression in the text box, or click the arrow to select columns from a list of columns that exist in the table.
    If the mass ingestion specification ingests data to a Hive target, you can also edit the Hive target properties for individual tables.
  11. Click
    Save
    .
    The
    Overview
    page for the mass ingestion specification appears.

0 COMMENTS

We’d like to hear from you!