Configure Hive Connector to download the distribution-specific Hive libraries
Configure Hive Connector to download the distribution-specific Hive libraries
You must configure Hive Connector to download the distribution specific Hive third-party libraries. The
Informatica Hive third-party script
and the
Informatica Hive third-party properties
files are available as part of the Hive Connector package in the Secure Agent installation.
Distributions applicable for Hive mappings
You can utilize the following distribution versions when you use Hive Connector to run mappings:
Cloudera CDH 6.1
Amazon EMR 5.20, 6.3, and 6.4
Cloudera CDP 7.1 private cloud and Cloudera CDW 7.2 public cloud
Azure HDInsight 4.0
Hortonworks HDP 3.1
Distributions applicable for Hive mappings in advanced mode
You can utilize the following distribution versions when Hive Connector runs on the advanced cluster:
Cloudera CDH 6.1
Cloudera CDP 7.1 private cloud and Cloudera CDW 7.2 public cloud
Azure HDInsight 4.0
Amazon EMR 6.1, 6.2, and 6.3
Perform the following tasks to download distribution specific Hive third-party libraries before you use Hive Connector:
Run the script to copy the third-party libraries to the Secure Agent location. Ensure that you have full permissions to the directories where the Hive libraries are copied.
The script is interactive and you need to specify the job type and the Hadoop cluster you want to use, when prompted.
Add the runtime DTM property,
INFA_HADOOP_DISTRO_NAME
, and set its value to the applicable distribution that you want to use.