Data Integration
- Data Integration
- All Products
ASK INFAPreview
Please log in to access Ask INFA.
ASK INFAPreview
Property
| Required / Optional
| Description
|
|---|---|---|
Override Code Task Timeout
| Optional
| Overrides the code task timeout value for this execution. A value of -1 signifies no timeout.
|
Log Level
| Optional
| Log level for session logs, agent job log, Spark driver, and executor logs. Valid values are: none, terse, normal, verboseInitialization, or verboseData.
The default value is normal.
|
Property
| Required / Optional
| Description
|
|---|---|---|
Main Class
| Required
| Entry point of the Spark application. For example:
org.apache.spark.examples.company.SparkExampleApp
|
Main Class Arguments
| Optional
| Ordered arguments sent to the Spark application main class. For example:
--appTypeSPARK_PI_FILES_JARS--
classesToLoadcom.company.test.SparkTest1Class
|
Primary Resource
| Required
| Scala JAR file that contains the
code task .
|
JAR File Path
| Optional
| The directory and file name of the JAR file that is uploaded to the cluster and added to the Spark driver and executor classpaths.
|
Spark File Path
| Optional
| The directory and file name of the Spark file that is uploaded to the cluster and available under the current working directory.
|
Custom Properties
| Optional
| Spark properties or other custom properties that
Data Integration uses.
|
