Use the Databricks cluster to perform data discovery on the Spark engine. The Databricks cluster is a environment to run the spark jobs. You can run a profile to perform data discovery for the Azure sources using the Databricks cluster.
You need to perform the following steps to connect to the Azure sources in the Databricks cluster:
Prerequisite
Add the following Advanced Spark configuration parameters for the Databricks cluster and restart the cluster: