Big Data Management User Guide

Back Next

Workflow Task Run-Time Behavior

Set mapping and Mapping task properties to specify where the workflow runs Mapping tasks.

You can create a cluster workflow to run some mappings on the cluster that the workflow creates, and other mappings on another cluster.

To specify where each mapping runs, configure options in the mapping and the Mapping task.

Run the mapping on the cluster that the workflow creates.: The following table describes the run-time behavior based on how you configure the mapping and Mapping task:

Mapping
Hadoop Connection Property
Mapping Task
Cluster Identifier Property
Run Time Behavior

Auto Deploy
Auto Deploy
The Data Integration Service generates temporary Hadoop connections based on the values in the Hadoop connection associated with the workflow, and uses the temporary connections to run mappings on the cluster.

<Hadoop connection name>
Auto Deploy
The Mapping task Cluster Identifier property overrides the mapping Hadoop connection property.
You might want to do this if you want to maintain the mapping Hadoop connection property value.
Run the mapping on another cluster.: The following table describes the run-time behavior based on how you configure the mapping and Mapping task:

Mapping
Hadoop Connection Property
Mapping Task
Cluster Identifier Property
Run Time Behavior

<Hadoop connection name>
Blank
The Mapping task Cluster Identifier property takes input from the Hadoop connection and runs the mapping on the cluster identified in the cloud configuration property of the Hadoop connection.

Mapping Hadoop Connection Property	Mapping Task Cluster Identifier Property	Run Time Behavior
Auto Deploy	Auto Deploy	The Data Integration Service generates temporary Hadoop connections based on the values in the Hadoop connection associated with the workflow, and uses the temporary connections to run mappings on the cluster.
<Hadoop connection name>	Auto Deploy	The Mapping task Cluster Identifier property overrides the mapping Hadoop connection property. You might want to do this if you want to maintain the mapping Hadoop connection property value.