Table of Contents

Search

  1. Preface
  2. Introduction to Data Engineering Administration
  3. Authentication
  4. Running Mappings on a Cluster with Kerberos Authentication
  5. Authorization
  6. Cluster Configuration
  7. Cloud Provisioning Configuration
  8. Data Integration Service Processing
  9. Appendix A: Connections Reference
  10. Appendix B: Monitoring REST API

Data Engineering Administrator Guide

Data Engineering Administrator Guide

MappingExecutionSteps

MappingExecutionSteps

With the MappingExecutionStats REST API, you can view execution steps for Hadoop jobs. You can also view the scripts for Hadoop jobs with the fetchScripts option.

GET Request

To request information from the MappingExecutionSteps with the associated scripts within the Hadoop scripts, use the following URL:
<RESTOperationsHubService_Host>:<RESTOperationsHubService_Port>/RestOperationsHub/services/v1/MappingService/MappingExecutionSteps(jobId='id',fetchScripts=true)
To request information from the MappingExecutionSteps without the associated scripts within the Hadoop scripts, use the following URL:
<RESTOperationsHubService_Host>:<RESTOperationsHubService_Port>/RestOperationsHub/services/v1/MappingService/MappingExecutionSteps(jobId='id',fetchScripts=false)
The following table describes the required attributes in the MappingExecutionSteps Get URL:
Field
Type
Description
userName
String
Required. User name to connect to the domain.
You can pass the input value as a header.
encryptedpassword
String
Required. Password for the user. Encrypt the password with the pmpasswd command line program.
You can pass the input value as a header.
securityDomain
String
Optional. The security domain to which the domain user belongs.
You can pass the input value as a header.
jobId
String
Required. The argument of the entity that contains the ID for the mappings.
You can pass the input value as a query.
fetchScripts
String
Required. Gets all associated scripts within the Hadoop scripts.
You can enter true to get the associated run tasks with the scripts. To get the associated run tasks without the scripts, enter false.

Get Response

Return information for the MappingExecutionSteps for the specified Job ID.
The following table describes the MappingExecutionSteps attributes present in the body of the response for Blaze environment:
Field
Description
Session Task
Response can include three types of session tasks that are pre session task, main session task, and post session task. The main session task can contain Submappings.
Instances
Transformation or object name.
endTime
End time of the job.
startTime
Start time of the job.
errorCode
Error code.
name
Name of the submapping task based on the run-time environment.
state
State of the mapping run.
subExecutionStepStat
Statistics for the sub execution step.
numOfFailedTasklets
Number of failed tasklets.
numOfSucceededTasklets
Number of succeeded tasklets.
numOfTasklets
Number of tasklets.
percentageCompletion
Percentage completion of tasklets.
webPageURL
Blaze monitoring tasklet URL.
incomingDependencies
Incoming dependencies contain pre session tasks.
outgoingDependencies
Outgoing dependencies contain post session tasks.
The following table describes the MappingExecutionSteps attributes present in the body of the response for Spark environment:
Field
Type
Description
jobId
String
The argument of the entity that contains the ID for the mapping.
fetchScripts
String
Gets all associated scripts within the Spark scripts.
You can enter true to get the associated run tasks with the scripts. To get the associated run tasks without the scripts, enter false.
executionStepStats
n/a
Container for the statistics related to mapping execution steps.
endTime
Integer
End time of the job.
startTime
Integer
Start time of the job.
errorCode
Integer
Error code.
errorMessage
Integer
Error message.
name
String
Name of the main mapping task based on the run-time environment.
state
String
State of the job run.
subExecutionStepStats
Integer
Statistics for the subexecution step statistics.
jobTrackerURL
String
The URL to the job tracker.
query
String
The main Spark query.

0 COMMENTS

We’d like to hear from you!