Table of Contents

Search

  1. Preface
  2. Introduction to Data Engineering Administration
  3. Authentication
  4. Running Mappings on a Cluster with Kerberos Authentication
  5. Authorization
  6. Cluster Configuration
  7. Cloud Provisioning Configuration
  8. Data Integration Service Processing
  9. Appendix A: Connections Reference
  10. Appendix B: Monitoring REST API

Data Engineering Administrator Guide

Data Engineering Administrator Guide

Importing a Databricks Cluster Configuration from the Cluster

Importing a Databricks Cluster Configuration from the Cluster

When you import the cluster configuration directly from the cluster, you provide information to connect to the cluster.
Before you import the cluster configuration, get cluster information from the Databricks administrator.
  1. From the
    Connections
    tab, click the
    ClusterConfigurations
    node in the Domain Navigator.
  2. From the Actions menu, select
    New
    Cluster Configuration
    .
    The
    Cluster Configuration
    wizard opens.
  3. Configure the following properties:
    Property
    Description
    Cluster configuration name
    Name of the cluster configuration.
    Description
    Optional description of the cluster configuration.
    Distribution type
    The distribution type. Choose
    Databricks
    .
    Method to import the cluster configuration
    Choose
    Import from cluster
    .
    Databricks domain
    Domain name of the Databricks deployment.
    Databricks access token
    The token ID created within Databricks, required for authentication. .
    If the token has an expiration date, verify that you get a new token from the Databricks administrator before it expires.
    Databricks cluster ID
    The cluster ID of the Databricks cluster.
    To find the cluster ID on the Databricks portal, follow these steps:
    1. Select
      Clusters
      from the object bar on the left side.
    2. Select the cluster you want to integrate with the Informatica domain.
    3. Click the
      Spark ID
      tab and expand the list of
      Spark Properties
      .
    4. Select the
      Tags
      tab.
    Create connection
    Choose to create a Databricks connection.
    If you choose to create a connection, the
    Cluster Configuration
    wizard associates the cluster configuration with the Databricks connection.
    If you do not choose to create a connection, you must manually create one and associate the cluster configuration with it.
  4. Click
    Next
    to verify the information on the summary page.

0 COMMENTS

We’d like to hear from you!