Table of Contents

Search

  1. Preface
  2. Part 1: Hadoop Integration
  3. Part 2: Databricks Integration
  4. Appendix A: Connections Reference

Importing a Hadoop Cluster Configuration from a File

Importing a Hadoop Cluster Configuration from a File

You can import properties from an archive file to create a cluster configuration.
Before you import from the cluster, you must get the archive file from the Hadoop administrator.
  1. From the
    Connections
    tab, click the
    ClusterConfigurations
    node in the Domain Navigator.
  2. From the Actions menu, select
    New
    Cluster Configuration
    .
    The
    Cluster Configuration
    wizard opens.
  3. Configure the following properties:
    Property
    Description
    Cluster configuration name
    Name of the cluster configuration.
    Description
    Optional description of the cluster configuration.
    Distribution type
    The cluster Hadoop distribution type.
    Distribution version
    Version of the Hadoop distribution.
    Each distribution type has a default version. This is the latest version of the Hadoop distribution that Data Engineering Integration supports.
    When the cluster version differs from the default version, the cluster configuration wizard populates the cluster configuration Hadoop distribution property with the most recent supported version relative to the cluster version. For example, suppose Informatica supports versions 5.10 and 5.13, and the cluster version is 5.12. In this case, the wizard populates the version with 5.10.
    You can edit the property to choose any supported version. Restart the Data Integration Service for the changes to take effect.
    Method to import the cluster configuration
    Choose
    Import from file
    to import properties from an archive file.
    Create connections
    Choose to create Hadoop, HDFS, Hive, and HBase connections.
    If you choose to create connections, the Cluster Configuration wizard associates the cluster configuration with each connection that it creates.
    The Hadoop connection contains default values for properties such as cluster environment variables, cluster path variables, and advanced properties. Based on the cluster environment and the functionality that you use, you can add to the default values or change the default values of these properties. For a list of Hadoop connection properties to configure, see Configuring Hadoop Connection Properties.
    If you do not choose to create connections, you must manually create them and associate the cluster configuration with them.
    When the wizard creates the Hive connection, it populates the Metadata Connection String and the Data Access Connection String properties with the value from the hive.metastore.uris property. If the Hive metastore and HiveServer2 are running on different nodes, you must update the Metadata Connection String to point to the HiveServer2 host.
  4. Click
    Browse
    to select a file. Select the file and click
    Open
    .
  5. Click
    Next
    and verify the cluster configuration information on the summary page.

0 COMMENTS

We’d like to hear from you!