Table of Contents

Search

  1. Preface
  2. Part 1: Hadoop Integration
  3. Part 2: Databricks Integration
  4. Appendix A: Connections

Prepare the Archive File for Import from Hortonworks HDP

Prepare the Archive File for Import from Hortonworks HDP

When you prepare the archive file for cluster configuration import from Hortonworks, include all required *-site.xml files and edit the file manually after you create it.
The Hortonworks cluster configuration archive file must have the following contents:
  • core-site.xml
  • hbase-site.xml. hbase-site.xml is required only if you access HBase sources and targets.
  • hdfs-site.xml
  • hive-site.xml
  • mapred-site.xml or tez-site.xml. Include the mapred-site.xml file or the tez-site.xml file based on the Hive execution type used on the Hadoop cluster.
  • yarn-site.xml

Update the Archive File

After you create the archive file, edit the Hortonworks Data Platform (HDP) version string wherever it appears in the archive file. Search for the string
${hdp.version}
and replace all instances with the HDP version that Hortonworks includes in the Hadoop distribution.
For example, the edited tez.lib.uris property looks similar to the following:
<property> <name>tez.lib.uris</name> <value>/hdp/apps/2.5.0.0-1245/tez/tez.tar.gz</value> </property>