Integration with the Databricks environment includes the following components:
Databricks Spark engine
The Databricks run-time engine based on the open-source Apache Spark engine.
Databricks File System (DBFS)
A distributed file system installed on Databricks Runtime clusters. Run-time data is staged in the DBFS and is persisted to a mounted Blob storage container.