Create a dedicated cluster connection, such as Hadoop or Databricks, to use with the cluster workflow.
The cluster connection saves property values for the Data Integration Service to use for cluster workflow operations. When you run a cluster workflow, the Data Integration Service uses settings in the cluster connection to run jobs on the cluster.
When you configure a Hadoop connection for the cluster workflow, populate the Cloud Provisioning Configuration property with the name of the cloud provisioning configuration you created for the workflow. Leave the Cluster Configuration property blank.
When you create the workflow, populate the Connection Name property of the Create Cluster task with this cluster connection.