Release Notes (10.4.1.3)

Release Notes (10.4.1.3)

Data Engineering Integration Known Issues (10.4.1.3)

Data Engineering Integration Known Issues (10.4.1.3)

The following table describes known issues:
Bug
Description
BDM-36874
When the Spark engine runs a mapping on a Cloudera CDP Public Cloud cluster, the mapping fails if you read from or write to a directory on the Data Lake cluster.
The mapping fails with the following error:
SEVERE: [LDTM_4872] HDFS source directory [/BDM_Automation/targetData/BZIP/m_all_compression_write_sparkMode] is not found. Specify a valid directory and try again.
BDM-36873
When you run a mapping on a Cloudera CDP Public Cloud cluster, the mapping fails if you read from or write to a relative path on the Data Lake cluster.
The mapping fails with the following error:
UNK_66008 File [hdfs://ns1/user/<impersonation_user>/SparkRelativePathDir//_tmp_infa_8365285398800525369_HDFS_RelativeSourceTarget.out/HDFS_RelativeSourceTarget.out/attempt_20210104065255_0000_m_000000_3] could not be opened because of the following error: [java.lang.IllegalArgumentException: Wrong FS: hdfs://ns1/user/<impersonation_user>/SparkRelativePathDir/_tmp_infa_8365285398800525369_HDFS_RelativeSourceTarget.out/HDFS_RelativeSourceTarget.out/attempt_20210104065255_0000_m_000000_3,
BDM-36445
BDM-36513
Reject file on Data Lake is not supported for Spark Engine and Blaze Engine.


Updated February 01, 2021