Mass Ingestion Guide

Back Next

Ingestion Statistics View

The Ingestion Statistics view lists the ingestion job statistics for a specific source table.

The following table describes the properties that you can view in the Ingestion Statistics view:

Property	Description
Source	The name of the source table that is ingested.
Status	The ingestion status of the source table. The status might display Completed, Failed, Running, Canceled, Queued, Unknown, or Working.
Run-time Engine	The run-time engine in the Hadoop environment that performs the ingestion job. The run-time engine is Spark.
Start Time	The time that the ingestion job for the source table is initiated.
End Time	The time that the ingestion job for the source table is completed.
Source	The statistics for the table rows that are from the source database. You can view the number of rows that were ingested successfully and the number of rows that contain errors.
Incremental Load	Details that describe the incremental data that was ingested. The details appear if the Spark engine used an incremental load to ingest the data. You can view the name of the column that the Spark engine used to fetch incremental data in the source table and the start value that determines the value that the Spark engine used to start ingesting the incremental data. For example, if the incremental key is an ID column and the start value is 2500, the Spark engine ingested the rows that have an ID of 2500 or higher.
Target	The statistics for the table rows that are ingested in the target. You can view the number of rows that were ingested successfully and the number of rows that contain errors.

To view certain statistics, you must enable Spark monitoring. Spark monitoring might impact performance.