Table of Contents

Search

  1. Preface
  2. Introduction to Mass Ingestion
  3. Prepare
  4. Create
  5. Deploy
  6. Run
  7. Monitor
  8. Appendix A: infacmd mi Command Reference

Mass Ingestion Guide

Mass Ingestion Guide

Create Overview

Create Overview

Create a mass ingestion specification in the Mass Ingestion tool.
When you create a mass ingestion specification, you configure the job that ingests data from a relational database to a Hive or HDFS target.
To create the mass ingestion specification, you use a wizard that helps you define the ingestion job. In the wizard, you configure different properties on each of the following pages:
  1. Definition. The type of specification that you want to create.
  2. Source. The source data that you want to ingest.
  3. Target. The Hive or HDFS target where you want to ingest data.
  4. Mass Transformations. Parameters that apply across all source tables that you ingest.
  5. Transformation Override. Parameters that apply to specific source tables that you ingest. These parameters override the parameters that you configure as mass transformations.
As you configure the mass ingestion specification, the Mass Ingestion Service validates the inputs. When you save the specification, the specification is stored in the Model repository.

0 COMMENTS

We’d like to hear from you!