When I run a mapping with a Hive source or a Hive target on a different cluster, the Data Integration Service fails to push the mapping to Hadoop with the following error:
Failed to execute query [exec0_query_6] with error code [10], error message [FAILED: Error in semantic analysis: Line 1:181 Table not found customer_eur], and SQL state [42000]].
When you run a mapping in a Hadoop environment, the Hive connection selected for the Hive source or Hive target, and the mapping must be on the same Hive metastore.
When I run a mapping with a Hadoop distribution on MapReduce 2, the Administrator tool shows the percentage of completed reduce tasks as 0% instead of 100%.
Verify that the Hadoop jobs have reduce tasks.
When the Hadoop distribution is on MapReduce 2 and the Hadoop jobs do not contain reducer tasks, the Administrator tool shows the percentage of completed reduce tasks as 0%.
When the Hadoop distribution is on MapReduce 2 and the Hadoop jobs contain reducer tasks, the Administrator tool shows the percentage of completed reduce tasks as 100%.
When I run a mapping that contains a Match transformation or a Consolidation transformation in a MapR 5.2 cluster, the mapping fails with the following error:
2017-05-25 04:31:57.363 <DTM-pool-2-thread-5> SEVERE: [HIVE_1070] The Integration Service failed to run Hive query [exec0_query_10] for task [exec0] due to following error: Hive error code [2], Hive message [FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask], Hive SQL state [08S01].
A Match transformation or a Consolidation transformation might use larger amounts of virtual memory that the default cluster configuration specifies. The default is 512MB. If you push a mapping that includes a Match transformation or a Consolidation transformation, increase the virtual memory to at least 700MB in the hadoopEnv.properties file. For example,
