PowerExchange Adapters for Informatica 10.2.2
- PowerExchange Adapters for Informatica 10.2.2
- All Products
When you run a mapping on the Spark Engine to write data to a Google Cloud Storage flat file target and the data size is greater than 750 MB, the mapping hangs indefinitely with the following error:
ERROR AbstractGoogleAsyncWriteChannel: Exception not convertible into handled response java.io.IOException: Write end dead
Workaround: Set the following property in the
Spark Execution Parametersin the Hadoop connection configured for the Spark engine:
When you run the mapping on a single spark executor instance, you may experience performance degradation.
When you specify the
Google Cloud Storage Pathin the
gs://<bucket name>format and run a mapping on the Spark engine to write data to a Google Cloud Storage target, the mapping fails.
Workaround: Specify the
Google Cloud Storage Pathin the following format:
When you use the
Create Targetoption to create a Google Cloud Storage target and select
Resource Format, fields are not getting propagated to the target.
Workaround: Create fields manually in the target file and run the mapping.