Developer Transformation Guide

Anterior Siguiente

Configure Spark Execution Parameters

To configure the Spark engine to run the Python transformation, configure the following Spark execution parameters:

infaspark.pythontx.executorEnv.LD_PRELOAD: The location of the Python shared library in the Python installation folder on the Data Integration Service machine. Required to run a Python transformation on the Spark engine.
For example, set to:
infaspark.pythontx.executorEnv.LD_PRELOAD= <Informatica installation directory>/services/shared/spark/python/lib/libpython3.6m.so
infaspark.pythontx.submit.lib.JEP_HOME: The location of the Jep package in the Python installation folder on the Data Integration Service machine. Required to run a Python transformation on the Spark engine.
For example, set to:
infaspark.pythontx.submit.lib.JEP_HOME= <Informatica installation directory>/services/shared/spark/python/lib/python3.6/site-packages/jep/

Enviar comentarios