Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Big Data Management
  3. Mappings
  4. Sources
  5. Targets
  6. Transformations
  7. Data Preview
  8. Cluster Workflows
  9. Profiles
  10. Monitoring
  11. Hierarchical Data Processing
  12. Hierarchical Data Processing Configuration
  13. Hierarchical Data Processing with Schema Changes
  14. Intelligent Structure Models
  15. Stateful Computing
  16. Connections
  17. Data Type Reference
  18. Function Reference

General Options

General Options

The following table describes the general options that you can set for a Databricks cluster:
Property
Description
Cluster Name
Name of the cluster to create.
Databricks Runtime Version
The Databricks version to run on the cluster.
Default is the latest supported version.
Driver Type
The type of node that you want to use for the driver node.
Default is the worker type ID.
Worker Type
The type of node that you want to use for the worker node.
Workers
The number of worker nodes to create for the cluster. If you configure the cluster to scale automatically, this property is ignored.
Default is 1.
Autoscale
Automatically scales the number of worker nodes based on workload.
Min Workers
The minimum number of worker nodes to use when the cluster is configured to scale automatically.
Default is 0.
Max Workers
The maximum number of worker nodes to use when the cluster is configured to scale automatically.
Default is 1.

0 COMMENTS

We’d like to hear from you!