Effective in version 10.4.0, you can run streaming mappings in Azure Databricks service in Microsoft Azure cloud services.
Sources and Targets
You can run streaming mappings against the following sources and targets within the Databricks environment:
Microsoft Azure Event Hubs
Azure Data Lake Storage Gen2 (ADLS Gen2)
You can add the following transformations to a Databricks streaming mapping:
The following data types are supported:
You can develop cluster workflows to create ephemeral clusters in the Databricks environment. Use Azure Data Lake Storage Gen1 (ADLS Gen1) and Azure Data Lake Storage Gen2 (ADLS Gen2) to create ephemeral clusters in the Databricks environment.
For more information about streaming mappings in Azure Databricks, see the