Integrating Informatica® Big Data Management 10.2.2 HF1 SP1 with Qubole

Back Next

Configure the Hadoop Connection

Hadoop connections contain default values for properties such as cluster environment variables, cluster path variables, and advanced properties. Based on the cluster environment and the functionality that you use, you can add to the default values or change the default values of these properties.

After you create Hadoop connections during cluster configuration, use the Administrator tool to edit the Hive connection to change the connection information for the Hive metadata repository:

In the Administrator tool, expand the list of connections.

The image below shows an example of the list of connections in the domain navigator:

The cluster configuration wizard creates connections and names them using the name of the cluster configuration as a suffix identifier. Each connection name begins with a connection type: HADOOP, HBASE, HDFS, and HIVE. In this image, the Hive connection is named HIVE_CCO_SPARK_BLAZE.

Open the HIVE connection.

In the Common Properties section of the connection properties, click the

Edit

icon to edit the properties.

Locate the Metadata Connection String property and change the port number to 10003.

Locate the Data Access Connection String property and change the port number to 10003.

Locate the Cluster Executable Path property and add the YARN executable path to the

$DEFAULT_CLUSTER_EXEC_PATH:

Run the

which yarn

command on the Qubole cluster to retrieve the YARN executable path. Add the YARN executable path till the

/bin

directory.

For example, add the following path after the

$DEFAULT_CLUSTER_EXEC_PATH:

in the Cluster Executable Path property:

/usr/lib/hadoop2/bin

Click

to save the changes.

For a full list of Hadoop connection properties to configure, see Hadoop Connection Properties.

Rename Saved Search

Table of Contents

Integrating Informatica® Big Data Management 10.2.2 HF1 SP1 with Qubole

Integrating Informatica® Big Data Management 10.2.2 HF1 SP1 with Qubole

Configure the Hadoop Connection

Configure the Hadoop Connection