When you create a cluster configuration associated with the Hadoop environment, the

Cluster Configuration

wizard can create Hadoop, HBase, HDFS, and Hive connections to access the Hadoop environment. When you create a cluster configuration associated with the Databricks environment, the

Cluster Configuration

wizard can create the Databricks connection. If you choose to create the connections, the wizard also associates the configuration object with the connections.

You can override the property values, and you can create user-defined properties based on your requirements. When property values change on the cluster, you can refresh the cluster configuration, either directly from the cluster or from an archive file.

The cluster configuration contains properties for the cluster type and version. You can edit the version property to any supported version. After you change the version, you must restart the Data Integration Service.

Consider the following high-level process to manage cluster configurations:

Import the cluster configuration, choosing to create connections that require the cluster configuration.
Edit the cluster configuration. Override imported property values and add user-defined properties.
Refresh the cluster configuration. When property values change on the cluster, refresh the cluster configuration to import the changes.