Release Notes (10.4.1.1)

Release Notes (10.4.1.1)

Data Engineering Streaming Known Limitations (10.4.1.1)

Data Engineering Streaming Known Limitations (10.4.1.1)

The following table describes known limitations:
Bug
Description
IIS-4998
On Cloudera CDP version 7.1.1, a streaming mapping with an Amazon Kinesis source publishes duplicate data to the target.
IIS-4996
When you run a streaming mapping that has a Python transformation with
CustomFunctionCall
, the mapping fails with the following error:
java.util.NoSuchElementException: head of empty list
Workaround
: In the Python transformation, create either equal or more number of output ports than input ports. The downstream transformations do not need to use these output ports.
IIS-4985
In a streaming mapping with a Kafka or Confluent Kafka source and Kafka, Confluent Kafka, or HDFS target, the mapping fails when the following conditions are true:
  • Target schema format is of type Flat
  • Mapping Flow
    option is enabled in the target
The mapping fails with the following error:
Error: Mapping is failed. Lost task 0.1 in stage 0.0 (TID 1,inbdsrh74qa01.informatica.com, executor 1): java.util.NoSuchElementException: next on empty iterator at scala.collection.Iterator$$anon$2.next(Iterator.scala:39)
IIS-4973
When you run a streaming mapping with a Kafka source and Amazon S3 target on Amazon EMR version 5.29 secure cluster, rollover of the Amazon S3 target files fail with
Access Denied
error.
IIS-4972
When you run a streaming mapping with a Kafka source and Hive target on Cloudera CDP version 7.1.1, Hortonworks HDP version 3.0, and HDInsight version 4.0, any pre-task for Hive table is not accepted. Truncate table, apply new schema, and apply new column are a few examples of pre-tasks.
IIS-4921
When you run a streaming mapping with a Kafka source and HDFS target on Cloudera CDP version 7.1.1, the mapping fails with a compilation error when the following conditions are true:
  • Topic name is linked to file name port and data to data port
  • Dynamic strategy is enabled at source
  • Run-time properties of the mapping is configured as
    infaspark.hive.impersonated.complexfile.write=true
IIS-4873
Cleanup task fails for a streaming mapping if the mapping contains a Java transformation and a Network File System (NFS) is configured as the
disTemp
directory of the domain.
This issue occurs on Hortonworks HDP version 3.0, HDInsight version 4.0, and Cloudera CDP version 7.1.1 clusters.
Workaround
: Configure the
disTemp
directory of the domain to point to a local file system.

0 COMMENTS

We’d like to hear from you!