Table of Contents

Search

  1. Preface
  2. Introduction to Hadoop Integration
  3. Before You Begin
  4. Amazon EMR Integration Tasks
  5. Azure HDInsight Integration Tasks
  6. Cloudera CDH Integration Tasks
  7. Hortonworks HDP Integration Tasks
  8. MapR Integration Tasks
  9. Appendix A: Connections

Hadoop Integration Guide

Hadoop Integration Guide

Prepare the Archive File for Import from Hortonworks HDP

Prepare the Archive File for Import from Hortonworks HDP

When you prepare the archive file for cluster configuration import from Hortonworks, include all required *-site.xml files and edit the file manually after you create it.
The Hortonworks cluster configuration archive file must have the following contents:
  • core-site.xml
  • hbase-site.xml. hbase-site.xml is required only if you access HBase sources and targets.
  • hdfs-site.xml
  • hive-site.xml
  • mapred-site.xml or tez-site.xml. Include the mapred-site.xml file or the tez-site.xml file based on the Hive execution type used on the Hadoop cluster.
  • yarn-site.xml

Update the Archive File

After you create the archive file, edit the Hortonworks Data Platform (HDP) version string wherever it appears in the archive file. Search for the string
${hdp.version}
and replace all instances with the HDP version that Hortonworks includes in the Hadoop distribution.
For example, the edited tez.lib.uris property looks similar to the following:
<property> <name>tez.lib.uris</name> <value>/hdp/apps/2.5.0.0-1245/tez/tez.tar.gz</value> </property>

0 COMMENTS

We’d like to hear from you!