Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Big Data Management
  3. Mappings
  4. Sources
  5. Targets
  6. Transformations
  7. Cluster Workflows
  8. Profiles
  9. Monitoring
  10. Hierarchical Data Processing
  11. Hierarchical Data Processing Configuration
  12. Hierarchical Data Processing with Schema Changes
  13. Intelligent Structure Models
  14. Stateful Computing
  15. Connections
  16. Data Type Reference
  17. Function Reference

User Guide

User Guide

General Options

General Options

The following table describes the general options that you can set for a Databricks cluster:
Property
Description
Cluster Name
Name of the cluster to create.
Databricks Runtime Version
The Databricks version to run on the cluster.
Default is the latest supported version.
Driver Type
The type of node that you want to use for the driver node.
Default is the worker type ID.
Worker Type
The type of node that you want to use for the worker node.
Workers
The number of worker nodes to create for the cluster. If you configure the cluster to scale automatically, this property is ignored.
Default is 1.
Autoscale
Automatically scales the number of worker nodes based on workload.
Min Workers
The minimum number of worker nodes to use when the cluster is configured to scale automatically.
Default is 0.
Max Workers
The maximum number of worker nodes to use when the cluster is configured to scale automatically.
Default is 1.

0 COMMENTS

We’d like to hear from you!