Integrating Informatica® Big Data Management 10.2.2 HF1 SP1 with Qubole

Back Next

Third Party Known Limitations

The following table describes third party known limitations:

Issue	Description
BDM-31946	When a Hive target is defined as a JSON SerDe target on a mapping that runs on Spark, the mapping fails with a "class not found" error. This happens because Hive fails to add the Hive catalog .jar file that enables Hive CLI. If you add the file manually, the mapping still fails due to the Spark issue listed below: Hive ticket reference number: HIVE-17624 Spark ticket reference number: SPARK-29002
BDM-31944	When a Hive target table has "APPLYNEWSCHEMA" enabled for the target schema strategy and the mapping is configured to run on Spark, the mapping fails with an error like: SQLException: [org.apache.hive.service.cli.HiveSQLException: java.io.IOException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassCastException: org.apache.hadoop.hive.serde2.io.HiveDecimalWritable cannot be cast to org.apache.hadoop.io.IntWritable Hive ticket reference number: HIVE-19317

Issue

Description

BDM-31946

When a Hive target is defined as a JSON SerDe target on a mapping that runs on Spark, the mapping fails with a "class not found" error. This happens because Hive fails to add the Hive catalog .jar file that enables Hive CLI. If you add the file manually, the mapping still fails due to the Spark issue listed below:

Hive ticket reference number: HIVE-17624

Spark ticket reference number: SPARK-29002

BDM-31944

When a Hive target table has "APPLYNEWSCHEMA" enabled for the target schema strategy and the mapping is configured to run on Spark, the mapping fails with an error like:

SQLException: [org.apache.hive.service.cli.HiveSQLException: java.io.IOException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassCastException: org.apache.hadoop.hive.serde2.io.HiveDecimalWritable cannot be cast to org.apache.hadoop.io.IntWritable

Hive ticket reference number: HIVE-19317

Troubleshooting the Big Data Management Integration with Qubole

Download Guide

Watch

Comments

Communities

Knowledge Base

Success Portal