Table of Contents


  1. Preface
  2. Introduction to Informatica Big Data Management
  3. Connections
  4. Mappings in a Hadoop Environment
  5. Mapping Objects in a Hadoop Environment
  6. Mappings in the Native Environment
  7. Profiles
  8. Native Environment Optimization
  9. Data Type Reference
  10. Function Reference
  11. Parameter Reference

Blaze Engine Logs

Blaze Engine Logs

The Blaze engine logs appear in the LDTM log and in the Hadoop cluster logs.
You can find the information about Blaze engine log events in the following log files:
LDTM log
The LDTM logs the results of the Blaze engines execution plan run for the mapping. You can view the LDTM log from the Developer tool or the Monitoring tool for a mapping job.
Blaze component and tasklet logs
The Blaze engine stores tasklet and Blaze component log events in temporary and permanent directories on the Hadoop cluster. The log file directories are specified by properties in the file located in the following location for each Hadoop distribution:
<Informatica Installation directory>/services/shared/hadoop/<distribution directory>/infaConf
The temporary directory is specified by the following property in the file:
. An administrator must create a directory with read, write, and execute permissions on all nodes on the Hadoop cluster.
For example, configure the following path for the property:
After the mapping completes, the Data Integration Service moves the tasklet log events from the temporary directory to a permanent directory on HDFS. The permanent directory is specified by the following property in the file:
For example, configure the following path for the property:
If you want to retain the tasklet logs in the temporary directory, set the value of the following property in the file to false:
If you do not configure the temporary or permanent directories, the tasklet log events appear in the directory configured for the DTM Process. You can get the directory for the DTM Process from the value for the
property in yarn-site.xml on the cluster node.
The following sample code describes the
<property> <name>yarn.nodemanager.local-dirs</name> <value>/var/lib/hadoop-yarn/cache/${}/nm-local-dir</value> <description>List of directories to store local files.</description> </property>

Updated July 03, 2018