Optionally, create a staging directory on HDFS for the Spark engine. For example:

hadoop fs -mkdir -p /spark/staging

If you want to write the logs to the Informatica Hadoop staging directory, you do not need to create a Spark staging directory. By default, the Data Integration Service uses the HDFS directory

/tmp/spark_<user name>

.

Grant permission to the following users:

Hadoop impersonation user
SPN of the Data Integration Service
Mapping impersonation users

Optionally, you can assign -777 permissions on the directory.