Table of Contents

Search

  1. Preface
  2. Introduction to Mass Ingestion
  3. Prepare
  4. Create
  5. Deploy
  6. Run
  7. Monitor
  8. Appendix A: infacmd mi Command Reference

Mass Ingestion Guide

Mass Ingestion Guide

Source

Source

The source describes the source data that you want to ingest from a relational database.
To define the source, select a JDBC connection and a schema to locate the database that you want to use. Then specify the tables that you want to ingest.
If you enable incremental load in the definition of the mass ingestion specification, you must configure the incremental load options for the source to define an incremental key.
The following image shows the Source page of the mass ingestion specification:
This screenshot shows the Source page of the mass ingestion specification. The Source page shows the following properties: Source Connection, Source Schema, and Source Tables. When you configure the source tables, the page shows two columns: Available and Selected. There are arrows in between the columns that help you transfer tables from the Available column to the Selected column. At the bottom, the page shows a section labeled Incremental Load Options. The Incremental Load Options section includes the following properties: Key Type and Key Column. You also have a Search option to locate tables in both columns. In the top-right corner, you have the option Next to go to the next page, or the button X to discard the specification.
The following table describes the properties that you can configure to define the source:
Property
Description
Source Connection
Required. The JDBC connection used to find the source schema.
If changes are made to the available JDBC connections, refresh the browser or log out and log back in to the Mass Ingestion tool.
Source Schema
Required. The schema that defines where the source tables are stored.
Source Tables
Required. The tables that will be ingested. Select the tables in the Available column and move the tables to the Selected column.
Key Type
Required if you enable incremental load. The type of incremental key. Select Timestamp or ID. Default is Timestamp.
Key Column
Required if you enable incremental load. The column name of the incremental key. If the key is a timestamp, the key column must store date/time data. If the key is an ID, the key column must store numeric data.

0 COMMENTS

We’d like to hear from you!