Installation and Upgrade Guide

11.0
- 10.0

Back Next

Preparing Fast Clone for Hadoop and Hive Targets

To load source data to a Hadoop distribution, you must complete several tasks to prepare the Fast Clone system. Fast Clone can load data to Cloudera CDH, Hive, and Hortonworks targets.

Install the 64-bit

Java Runtime Environment (JRE) 1.8

Define the JAVA_HOME environment variable to point to the root Java installation directory.

Add a Java library to the system path.

On Windows, add the directory that contains the jvm.dll library to the PATH environment variable. For example, use the following command:

PATH=%PATH%;%JAVA_HOME%\jre\bin\server

On Linux and UNIX, add the directory that contains the libjvm.so library to the library path environment variable for your operating system. The library path environment variables are:

LD_LIBRARY_PATH for Linux and Solaris systems

LIBPATH for AIX systems

SHLIB_PATH for HP-UX systems

For example, use the following command:

LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$JAVA_HOME/jre/lib/amd64/server

Unpack the .jar file package to the FastClone_installation directory.

If you do not want to copy the .jar files to the FastClone_installation directory, define the

IFC_HDFS_LIBS

environment variable. In this variable, list the paths to the

.jar

files, including the file names. These paths can be either full paths or relative to the FastClone_installation directory.

On Windows, use the semicolon as a separator in the list of paths to the .jar files. For example:

SET IFC_HDFS_LIBS=lib/hadoop/hadoop-core-0.20.2-cdh3u4.jar;lib/hadoop/guava-11.0.2.jar

On Linux and UNIX, use a colon as the separator in the list of paths to the .jar files. For example:

IFC_HDFS_LIBS=lib/hadoop/hadoop-core-0.20.2-cdh3u4.jar:lib/hadoop/guava-11.0.2.jar

Rename Saved Search

Table of Contents

Installation and Upgrade Guide

Installation and Upgrade Guide

Preparing Fast Clone for Hadoop and Hive Targets

Preparing Fast Clone for Hadoop and Hive Targets