Table of Contents

Search

  1. Preface
  2. Introduction to Hive Connector
  3. Hive connections
  4. Mappings and mapping tasks with Hive Connector
  5. Migrating a mapping
  6. Data type reference
  7. Troubleshooting

Hive Connector

Hive Connector

Configure Hive Connector to download the distribution-specific Hive libraries

Configure Hive Connector to download the distribution-specific Hive libraries

You must configure Hive Connector to download the distribution specific Hive third-party libraries. The
Informatica Hive third-party script
and the
Informatica Hive third-party properties
files are available as part of the Hive Connector package in the Secure Agent installation.

Distributions applicable for Hive mappings

You can utilize the following distribution versions when you use Hive Connector to run mappings:
  • Cloudera CDH 6.1
  • Amazon EMR 5.20, 6.3, and 6.4
  • Cloudera CDP 7.1 private cloud and Cloudera CDW 7.2 public cloud
  • Azure HDInsight 4.0
  • Hortonworks HDP 3.1

Distributions applicable for Hive mappings in advanced mode

You can utilize the following distribution versions when Hive Connector runs on the advanced cluster:
  • Cloudera CDH 6.1
  • Cloudera CDP 7.1 private cloud and Cloudera CDW 7.2 public cloud
  • Azure HDInsight 4.0
  • Amazon EMR 6.1, 6.2, and 6.3
Perform the following tasks to download distribution specific Hive third-party libraries before you use Hive Connector:
  1. Run the script to copy the third-party libraries to the Secure Agent location. Ensure that you have full permissions to the directories where the Hive libraries are copied.
    The script is interactive and you need to specify the job type and the Hadoop cluster you want to use, when prompted.
  2. Add the runtime DTM property,
    INFA_HADOOP_DISTRO_NAME
    , and set its value to the applicable distribution that you want to use.
  3. Restart the Secure Agent.

0 COMMENTS

We’d like to hear from you!