Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Big Data Management
  3. Connections
  4. Mappings in the Hadoop Environment
  5. Mapping Objects in the Hadoop Environment
  6. Monitoring Mappings in the Hadoop Environment
  7. Mappings in the Native Environment
  8. Profiles
  9. Native Environment Optimization
  10. Data Type Reference
  11. Function Reference
  12. Parameter Reference
  13. Multiple Blaze Instances on a Cluster

Create Blaze Engine Directories and Grant Permissions

Create Blaze Engine Directories and Grant Permissions

Create the following directories on the Hadoop cluster:
Local services log directory
Create a local services log directory on all nodes in the cluster and grant permissions to the Blaze user account. The hadoopEnv.properties file on the domain contains an entry for this directory. The file uses an environment variable, $HADOOP_NODE_INFA_HOME, that gets set to the Big Data Management installation directory. The default installation directory is
/opt/Informatica
. For example, run the following commands:
hadoop fs mdkir -p /opt/Informatica/blazeLogs
hadoop fs -chmod 777 /opt/Informatica/blazeLogs
If you use a different directory name, you must update the following property in the hadoopEnv.properties file:
infagrid.node.local.root.log.dir
HDFS temporary working directory
Create a working directory on HDFS for the Blaze engine and grant permissions to the Blaze user account. For example, run the following commands:
hadoop fs mkdir -p /blaze/workdir
hadoop fs -chmod 777 /blaze/workdir
When you configure connection properties, you provide the path to this directory. Alternatively, you can create this directory when you create the connection.
This directory is separate from the aggregated persistent log directory.
Verify that a persistent aggregated HDFS log directory exists on the cluster. For example,
/var/log/Hadoop-yarn/apps/Informatica
.
It is not necessary to create a new directory for persistent logs. Both Blaze instances can use the same persistent aggregated HDFS log directory.


Updated July 03, 2018