Effective in version 10.1.1, you can configure the Spark engine on all supported Hadoop distributions. You can configure Big Data Management to use one of the following Spark versions based on the Hadoop distribution that you use:
Cloudera Spark 1.6 and Apache Spark 2.0.1 for Cloudera cdh5u8 distribution.
Apache Spark 2.0.1 for all Hadoop distributions.
For more information, see the
Informatica Big Data Management 10.1.1 Installation and Configuration Guide.