Read from Microsoft Azure Data Lake Storage Gen2 and write to Databricks
Read from Microsoft Azure Data Lake Storage Gen2 and write to Databricks
You can configure
SQL ELT optimization
for a mapping that uses an Microsoft Azure Data Lake Storage Gen2 connection in the Source transformation to read from Microsoft Azure Data Lake Storage Gen2 and a Databricks connection in the Target transformation to write to Databricks.
Example
You want to load data from an Microsoft Azure Data Lake Storage Gen2 based storage object to Databricks for analytical purposes. You want to transform the data before it is made available to users. Use an Microsoft Azure Data Lake Storage Gen2 connection to read data from a Microsoft Azure Data Lake Storage Gen2 source and a Databricks connection to write to a Databricks target. Configure full
SQL ELT optimization
in the mapping task to optimize the performance of loading data to Databricks.
SQL ELT optimization
enhances the performance of the task and reduces the cost involved.
ASK INFAPreview
