Table of Contents

Search

  1. Preface
  2. Workflows
  3. Workflow Variables
  4. Workflow Parameters
  5. Cluster Tasks
  6. Command Task
  7. Human Task
  8. Mapping Task
  9. Notification Task
  10. Gateways
  11. Workflow Recovery
  12. Workflow Administration

Developer Workflow Guide

Developer Workflow Guide

Delete Cluster Task

Delete Cluster Task

The Delete Cluster task terminates and deletes a Hadoop cluster on a cloud platform.
If you do not add a Delete Cluster task in a cluster workflow, the cluster remains running when the workflow ends.
A cluster that you create and then terminate when jobs are complete is called an ephemeral cluster.
Set the following properties for the Delete Cluster task:
  • In the General properties, optionally rename the Delete Cluster task.
  • In the Advanced properties, set the Task Recovery Strategy property to Restart task.
When you create a Databricks job cluster to run mapping and other tasks, Databricks deletes the cluster automatically after completing all tasks. You don't need to include a Delete Cluster task in the workflow.

0 COMMENTS

We’d like to hear from you!