Table of Contents

Search

  1. Preface
  2. Monitoring jobs
  3. Monitoring Data Integration jobs
  4. Data Integration job log files
  5. Monitoring Mass Ingestion jobs
  6. Monitoring Data Accelerator for Azure jobs
  7. Monitoring Data Profiling jobs
  8. Monitoring imports and exports
  9. Monitoring file transfer jobs
  10. Monitoring elastic clusters
  11. Monitoring source control logs

Monitor

Monitor

File events

File events

The File Events section shows the total number of files that the
mass ingestion
task has transferred, with information about each file.
The File Events section is updated each time the
mass ingestion
task transfers a file, and the state of the file updates throughout the file transfer process. You can track the progress of the transfer of a file based on the state of the file.
The File Events section displays the following properties for each file:
Property
Description
Name
The name of the file.
File size
The size of the file in bytes.
State
The state of the file transfer. A file can have one of the following states:
  • Success. The file transfer completed successfully.
  • Failed. The file transfer did not complete because it encountered errors.
  • Processing. The file transfer is still running.
  • Duplicate. The task previously transferred a file with the same name, directory location, and size.
  • Interrupted. The file transfer is interrupted because of network issues or changed server credentials during the file transfer. Run the
    mass ingestion
    task to resume the transfer of the interrupted files. This state is applicable when the
    mass ingestion
    task transfers file from the advanced FTP, advanced SFTP, or advanced FTPS sources.
  • In Doubt. The previous task instance encountered errors while transferring the file. Applicable for tasks where the source is configured to skip duplicate files.
You can monitor the State property to track the progress of the file transfer of each file.
Transfer Type
The type of file transfer. A file can have one of the following transfer types:
  • <source_name>
    Download. The file is downloaded from source.
    <source_name>
    is the name of the source.
  • <target_name>
    Upload. The file is uploaded to the target.
    <target_name>
    is the name of the target.
  • Copy from Source. The
    mass ingestion
    task is performing file processing actions.
  • Copy to Target. The file is transferred from a local directory to a local directory.
Start time
Date and time when the file transfer started.
Duration
The length of time to transfer the file, in milliseconds.
Remarks
Applicable for file events in Failed status. The message includes the reason for failure of the event based on the file transfer type.


Updated August 03, 2020