Release Notes (10.4.1.1)

Release Notes (10.4.1.1)

Data Engineering Integration Fixed Limitations (10.4.1.1)

Data Engineering Integration Fixed Limitations (10.4.1.1)

Fixed Limitations

The following table describes fixed limitations:
Issue
Description
BDM-34680
When the Spark engine runs a mapping that executes a Hive query, the mapping might fail with error
java.lang.OutOfMemoryError: Java heap space
.
BDM-34734
On a Hortonworks HDP cluster, when the Blaze engine runs a mapping that reads date type data from a Hive source stored in Parquet format, the mapping fails.
On an HDP 2.6 cluster, the mapping fails with the following error message:
[GRIDDTM_1016] The Integration Service failed to execute grid mapping with following error [An internal exception occurred with message: java.lang.ClassCastException: org.apache.hadoop.io.IntWritable cannot be cast to org.apache.hadoop.hive.serde2.io.DateWritable
On an HDP 3.1 cluster, the mapping fails with the following error message:
[GRIDDTM_1016] The Integration Service failed to execute grid mapping with following error [An internal exception occurred with message: java.lang.ClassCastException: org.apache.hadoop.io.IntWritable cannot be cast to org.apache.hadoop.hive.serde2.io.DateWritableV2
BDM-34445
When the Blaze engine runs a mapping where the source is a Hive transactional table and column names in the Hive source have a case mismatch with columns in the physical data object of the mapping, the mapping might fail or return no data.
BDM-34343
BDM-31535
Mappings that run on the Spark engine fail intermittently when the Data Integration Service fails to fetch delegation token for Hive metastore. For more information, see the following Knowledge Base article: https://kb.informatica.com/solution/23/Pages/69/568300.aspx
BDM-33894
When the Spark engine runs a mapping on a Cloudera CDP cluster with dynamic resource allocation enabled, the mapping fails with the following SPARK_1003 error:
"Failed to connect to <node running Spark shuffle service>"
BDM-33751
BDM-34638
When the Blaze engine reads a modified Hive partition table of text format, the source read fails with the following error:
[CORE_3] An internal exception occurred with message: java.lang.RuntimeException: No data found for parttion state java.lang.RuntimeException: No data found for partition state
BDM-33677
On a Hortonworks HDP 3.1 cluster, when the Blaze engine processes the TO_CHAR function to convert timestamp data from a Hive source to character strings, the mapping fails with the following error:
SEVERE: The Integration Service failed to execute the mapping. java.lang.RuntimeException: java.util.concurrent.CompletionException: com.informatica.sdk.dtm.ExecutionException: [GRIDDTM_1016] The Integration Service failed to execute grid mapping with following error [An internal exception occurred with message: java.lang.ClassCastException: org.apache.hadoop.hive.serde2.io.TimestampWritableV2 cannot be cast to org.apache.hadoop.hive.serde2.io.TimestampWritable].
BDM-31896
When you run a mapping on a Hortonworks HDP 3.x cluster, the mapping fails when the following conditions are true:
  • In the Hadoop cluster properties,
    hive.server2.enable.doAs
    is set to false.
  • In the core-site.xml properties,
    hadoop.proxyuser.<proxy user>.groups
    and
    hadoop.proxyuser.<proxy user>.users
    do not include the Hive user.
The mapping fails with the following error:
org.apache.hadoop.ipc.RemoteException (org.apache.hadoop.security.authorize.AuthorizationException): User: <user> is not allowed to impersonate hive

0 COMMENTS

We’d like to hear from you!