Table of Contents

Search

  1. Preface
  2. Introduction to Mass Ingestion
  3. Prepare
  4. Create
  5. Deploy
  6. Run
  7. Monitor
  8. infacmd mi Command Reference

Mass Ingestion Guide

Mass Ingestion Guide

Create Overview

Create Overview

Create a mass ingestion specification in the Mass Ingestion tool.
When you create a mass ingestion specification, you configure the job that ingests data from a relational database to Hive or HDFS. You select the relational database that contains the data that you want to ingest and you configure the target where you want to ingest the specified data. When you create a mass ingestion specification, the Mass Ingestion Service validates the inputs and stores the specification in the Model repository.
When you create the mass ingestion specification, you use a wizard that helps you configure the ingestion job. In the wizard, you define the following properties:
  1. Definition. Describe the type of specification that you want to create.
  2. Source. Define the source database that you want to use to ingest data.
  3. Target. Define the Hive or HDFS target where you want to ingest data.
  4. Mass Transformations. Define the transformations to apply parameters across all source tables that you ingest.
  5. Transformation Override. Override the mass transformations and specify parameters for specific tables.

0 COMMENTS

We’d like to hear from you!