Data Engineering Integration
- Data Engineering Integration 10.5.3
- All Products
Property
| Description
|
---|---|
spark_version
| The version of Spark to use in the cluster. Required.
|
node_type_id
| The node type and size, expressed as one of the node types supported on AWS or Azure. Required.
|
num_workers
| The number of worker nodes in the cluster.
Required if you do not use the autoscale parameter.
|
autoscale
| Use autoscale=true to create a cluster that uses autoscale.
Required if you do not use the num_workers parameter.
|