Data Engineering Administrator Guide

10.5.1
- 10.5.7
- 10.5.6
- 10.5.2
- 10.5
- 10.4.1
- 10.4.0
- 10.2.2 HotFix 1
- 10.2.2 Service Pack 1
- 10.2.2
- 10.2.1

Back Next

Cloud Provisioning Configuration

The cloud provisioning configuration establishes a relationship between the Create Cluster task and the cluster connection that the workflows use to run mapping tasks. The Create Cluster task must include a reference to the cloud provisioning configuration. In turn, the cloud provisioning configuration points to the cluster connection that you create for use by the cluster workflow.

The properties to populate depend on the Hadoop distribution you choose to build a cluster on. Choose one of the following connection types:

AWS Cloud Provisioning. Connects to an Amazon EMR cluster on Amazon Web Services.

Azure Cloud Provisioning. Connects to an HDInsight cluster on the Azure platform.

Databricks Cloud Provisioning. Connects to a Databricks cluster on the Azure Databricks platform.

Appendix A: Connections Reference

AWS Cloud Provisioning Configuration Properties

Azure Cloud Provisioning Configuration Properties

Databricks Cloud Provisioning Configuration Properties

Download Guide

Watch

Comments

Communities