On the Azure and AWS Databricks platforms, you can configure Databricks ephemeral clusters.
Optionally, you can configure the clusters to start from sets of cached VM instances, called warm pools. These instances wait on standby in a running state for ephemeral cluster creation. You can choose to have the instances remain on standby when the ephemeral clusters are terminated. For more information, see the
Enable warm pools for ephemeral Databricks clusters in the advanced properties of the Create Cluster workflow task.