The Delete Cluster task terminates and deletes a Hadoop cluster on a cloud platform.
If you do not add a Delete Cluster task in a cluster workflow, the cluster remains running when the workflow ends.
A cluster that you create and then terminate when jobs are complete is called an ephemeral cluster.
Set the following properties for the Delete Cluster task:
In the General properties, optionally rename the Delete Cluster task.
In the Advanced properties, set the Task Recovery Strategy property to Restart task.
When you create a Databricks job cluster to run mapping and other tasks, Databricks deletes the cluster automatically after completing all tasks. You don't need to include a Delete Cluster task in the workflow.