Cloud Platform
All Products
Property | Description
|
---|---|
Status | Status of the Spark task.
The Spark task can have one of the following statuses:
If the Secure Agent fails while the
elastic job is running, the status of the Spark tasks continues to display Running. You must cancel the job and run the job again.
|
Start time | Date and time
when the Spark task started. |
End
time | Date and time when the Spark task ended.
|
Duration | Amount of time
that the Spark task ran. |
Memory Per Executor | Amount of
memory that each Spark executor uses. |
Cores Per Executor | Number of
cores that each Spark executor uses. |
Driver and Agent Job Logs | Select
Download to download the Spark driver and agent job
logs. |
Advanced Log Location | The
log location that is configured in the elastic configuration for the elastic
cluster. You can navigate to the advanced log location to view and download the
agent job log, Spark driver log, and Spark executor logs. |
Property | Description
|
---|---|
Job
Name | Name of the Spark job or stage. |
Start time | Date and time
when the Spark job or stage started. Start time might be "NA" for aborted
tasks. |
End
time | Date and time when the Spark job or stage
ended. End time might be "NA" for aborted tasks. |
Duration | Amount of time that the
Spark job or stage ran. |
Total Tasks | Number of tasks the
Spark job or stage attempted. |
Successful Tasks | Number of tasks
the Spark job or stage sucessfully completed. |
Failed Tasks | Number of tasks
that the Spark job or stage failed to complete. |
Running Tasks | Number of tasks
that the Spark job or stage is currently running. |
Input Size / Records | Size of the
file and number of records input by the Spark job or stage. |
Output Size / Records | Size of
the file and number of records output by the Spark job or stage. |
Status | Status of the Spark
job or stage. The status can be one of the following values:
After you abort a
mapping task, there might
be some lag time before the Monitor service shows the status as
Aborted .
|
Updated January 22, 2021