Table of Contents

Search

  1. Preface
  2. Monitoring jobs
  3. Monitoring Data Integration jobs
  4. Data Integration job log files
  5. Monitoring Mass Ingestion jobs
  6. Monitoring Data Accelerator for Azure jobs
  7. Monitoring Data Profiling jobs
  8. Monitoring imports and exports
  9. Monitoring file transfer jobs
  10. Monitoring elastic clusters
  11. Monitoring source control logs

Monitor

Monitor

Ingestion Task step properties

Ingestion Task step properties

The Ingestion Task step properties display details about the current run of the Ingestion task of a taskflow.
When you click an Ingestion Task step, the
Properties
panel displays the following information:
Property
Description
Current Run
Displays the following details:
  • Status. Status of the mass ingestion task.
  • Start Date. Date and time when the mass ingestion task started.
  • End Date. Date and time when the mass ingestion task ended or was suspended.
  • Duration. Amount of time in seconds that the mass ingestion task ran before it completed or was suspended.
  • Started By. Name of the taskflow that called the mass ingestion task.
General
Displays the name of the Ingestion Task step.
Ingestion Task
Displays the name and type of the ingestion task that the Ingestion Task step contains.
The type is set to
MI_TASK
for mass ingestion tasks.
Input Fields
Displays the following input fields:
  • Wait for Task to Complete. Indicates whether the Ingestion Task step waits for the mass ingestion task to complete. This value is always set to
    true
    .
  • Max Wait. Maximum time in seconds that the Ingestion Task step waits for the mass ingestion task to complete. This value is always set to
    604800
    seconds, which is 7 days.
  • Task Name. Name of the mass ingestion task.
  • GUID. Unique identification number for the mass ingestion task.
  • Task Type. Indicates the type of task that the Ingestion Task step contains. This value is always set to
    MI_TASK
    for mass ingestion tasks.
  • serviceProviderId. Service provider ID for the mass ingestion task. This value is always set to
    filelistener
    .
  • serviceProviderContextPath. Service provider context path for the mass ingestion task. This value is always set to
    mitask/
    .
Output Fields
Displays the following output fields if the Ingestion Task step completed successfully:
  • endTime. Date and time when the mass ingestion task completed.
  • failedFiles. Number of failed files in the mass ingestion task run.
  • jobNumber. ID for the mass ingestion task run.
  • messageText. Indicates whether the job completed normally. This value is always set to
    Job completed normally
    .
  • startTime. Date and time when the mass ingestion task started.
  • status. Indicates whether the Ingestion Task step completed completed. This value is always set to
    Success
    .
  • successFiles. Number of files that were successfully processed in the mass ingestion task.
  • fileDetails. Provides a list of objects with the following details:
    • Duration. Amount of time in seconds that the mass ingestion task ran before it completed.
    • Last modified. Date and time when the file was last modified.
    • Path. Name of the file and the path where the file exists.
    • Size. Size of the file in KB.
    • Status. Indicates the status of the file transfer. This value is always set to
      Success
      .
    • Transfer direction. Indicates the transfer direction for the file. You see one of the following values:
      • DOWNLOAD. The file was downloaded from the source.
      • UPLOAD. The file was uploaded to the target.
Fault
If the ingestion task faulted, you see the following properties:
  • Code. Indicates whether the fault is an error or a warning.
  • Reason. Cause of the error or fault.
Consider the following rules and guidelines when you monitor the Ingestion Task step:
  • The
    All Jobs
    page does not display the ingestion task as a subtask. It always displays the number of rows processed as
    0
    if the taskflow includes an Ingestion Task step.
  • If the ingestion task faulted and the
    On Error
    property was set to
    Suspend Taskflow
    , no information is displayed in the
    Properties
    panel.


Updated August 03, 2020