Step 1. Create Symbolic Links for the Library Files in the Spark Nodes
You must create symbolic links for the required library files in all the Spark nodes and copy the population files, configuration file, matching rules file to all the Spark nodes.
- Copy the following
.so files to a Spark node:
- /usr/local/mdmbdrm-<Version Number>/bin/libjssan3cl.so
- /usr/local/mdmbdrm-<Version Number>/bin/libjssan3clex.so
- /usr/local/mdmbdrm-<Version Number>/bin/libssaiok.so
- /usr/local/mdmbdrm-<Version Number>/bin/libssalsn.so
- /usr/local/mdmbdrm-<Version Number>/bin/libssan3cl.so
- /usr/local/mdmbdrm-<Version Number>/bin/libssan3tb.so
- /usr/local/mdmbdrm-<Version Number>/bin/libssan3v2.so
- Create symbolic links to all the
.so files in the following directory of the Spark node:
$HADOOP_HOME/lib/native
The following sample command creates symbolic links in the
$HADOOP_HOME/lib/native directory for all the
.so files:
ln -s /usr/local/libraryfiles/*.so /usr/lib/hadoop/lib/native/
- Copy the population files to the same directory that you configured for the
ssapr parameter of the configuration file in the Spark node.
For example, if
ssapr=/usr/local/mdmbdrm-10.0/population, create the same directory structure in the Spark node and copy the population files to the
population directory.
- Copy the configuration file and the matching rules file to the Spark node.
Ensure that you use the same directory structure in all the Spark nodes.
