Table of Contents

Search

  1. Preface
  2. Introduction to Mass Ingestion
  3. Prepare
  4. Create
  5. Deploy
  6. Run
  7. Monitor
  8. Appendix A: infacmd mi Command Reference

Mass Ingestion Guide

Mass Ingestion Guide

Ingestion Statistics View

Ingestion Statistics View

The Ingestion Statistics view lists the ingestion job statistics for a specific source table.
The following table describes the properties that you can view in the Ingestion Statistics view:
Property
Description
Source
The name of the source table that is ingested.
Status
The ingestion status of the source table. The status might display Completed, Failed, Running, Canceled, Queued, Unknown, or Working.
Run-time Engine
The run-time engine in the Hadoop environment that performs the ingestion job. The run-time engine is Spark.
Start Time
The time that the ingestion job for the source table is initiated.
End Time
The time that the ingestion job for the source table is completed.
Source
The statistics for the table rows that are from the source database. You can view the number of rows that were ingested successfully and the number of rows that contain errors.
Incremental Load
Details that describe the incremental data that was ingested. The details appear if the Spark engine used an incremental load to ingest the data. You can view the name of the column that the Spark engine used to fetch incremental data in the source table and the start value that determines the value that the Spark engine used to start ingesting the incremental data.
For example, if the incremental key is an ID column and the start value is 2500, the Spark engine ingested the rows that have an ID of 2500 or higher.
Target
The statistics for the table rows that are ingested in the target. You can view the number of rows that were ingested successfully and the number of rows that contain errors.
To view certain statistics, you must enable Spark monitoring. Spark monitoring might impact performance.

0 COMMENTS

We’d like to hear from you!