Table of Contents

Search

  1. Preface
  2. Introduction to Data Engineering Administration
  3. Authentication
  4. Running Mappings on a Cluster with Kerberos Authentication
  5. Authorization
  6. Cluster Configuration
  7. Cloud Provisioning Configuration
  8. Data Integration Service Processing
  9. Appendix A: Connections Reference
  10. Appendix B: Monitoring REST API

Data Engineering Administrator Guide

Data Engineering Administrator Guide

Create a Cluster Connection

Create a Cluster Connection

Create a dedicated cluster connection, such as Hadoop or Databricks, to use with the cluster workflow.
The cluster connection saves property values for the Data Integration Service to use for cluster workflow operations. When you run a cluster workflow, the Data Integration Service uses settings in the cluster connection to run jobs on the cluster.
When you configure the connection, populate the Cloud Provisioning Configuration property with the name of the cloud provisioning configuration that you created for the workflow. Leave the Cluster Configuration property blank.
When you create the workflow, populate the Connection Name property of the Create Cluster task with this cluster connection.
For information about creating connections in the Administrator tool, see the Connections Reference in the
Data Engineering Administrator Guide
.

0 COMMENTS

We’d like to hear from you!