Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Ask INFA.

Table of Contents

Search

  1. Preface
  2. Introduction to Databricks Connector
  3. Connections for Databricks
  4. Mappings for Databricks
  5. Migrating a mapping
  6. SQL ELT with Databricks Connector
  7. Data type reference
  8. Troubleshooting

Databricks Connector

Databricks Connector

Enable SQL ELT optimization for a mapping task

Enable SQL ELT optimization for a mapping task

In a task enabled with SQL ELT optimization, you can select the optimization type to push some or all the transformation logic. Data Integration pushes the transformation logic to the source or target database based on the optimization type you specify in the task properties.
To enable SQL ELT optimization, add the configured mapping
or mapping in advanced mode
to a mapping task, and then enable SQL ELT optimization in the mapping task.
You can configure Full, Source, and other optimization configurations in the
SQL ELT optimization
advanced session properties on the
Runtime Options
tab. Data Integration processes any transformation logic that isn't pushed to the sources and targets on the on the Data Integration Server and on an advanced cluster.
You can enable SQL ELT optimization in a mapping task to load data from the following data sources to Databricks:
  • Amazon S3
  • Databricks
  • Google Cloud Storage
  • Microsoft Azure Data Lake Storage Gen2
For more information on SQL ELT optimization, see SQL ELT optimization for a mapping task.

0 COMMENTS

We’d like to hear from you!