Monitoring Mappings in the Hadoop Environment Overview
Monitoring Mappings in the Hadoop Environment Overview
On the Monitor tab of the Administrator tool, you can view statistics and log events for mappings run in the Hadoop environment. The Monitor tab displays current and historical information about mappings run on Blaze, Spark, and Hive engines.
Use the Summary Statistics view to view graphical summaries of object state and distribution across the Data Integration Services. You can also view graphs of the memory and CPU that the Data Integration Services used to run the objects.
When you run a mapping in the Hadoop environment, the Data Integration Service generates log events. You can view log events relating to different types of errors such as Hadoop connection failures, Hive query failures, Hive command failures, or other Hadoop job failures.
When you run Hive mappings or Spark jobs that launches Hive tasks, you can select Tez or MapReduce engines and monitor statistics.