Test Data Management 10.5
- Test Data Management 10.5
- All Products
When you explicitly set ZLIB compression for ORC tables in a mapping that runs on the Spark engine, the Spark workflow generates an additional execution step that causes the mapping to fail.
When you run a mapping on a complex file source in Spark mode, the mapping does not write data to the target file if both the following conditions are true:
Mappings that run on a Cloudera CDH 6.3 cluster to read from or write to a Parquet file fail with the following error:
NoSuchFieldError: ZSTD inside ParquetOptions.scala:85
Mappings that run on the Spark engine for more than 24 hours fail with delegation token error. This issue occurs in a cluster on Cloudera CDH version 6.3.
When the Spark engine runs a mapping that includes an Update Strategy transformation that performs an INSET, UPDATE or DELETE operation and the source includes duplicate rows, the mapping fails with a "Cardinality Violation in Merge statement" error.
When you run enterprise discovery profile jobs using a resource configured on Enterprise Data Catalog, the pmdtmsvc2 DTM process intermittently shuts down. The DTM shutdown results in inconsistent states for mappings that run on the DTM.