Table of Contents

Search

  1. Preface
  2. Part 1: Getting Started with Snowflake Data Cloud Connector
  3. Part 2: Data Integration with Snowflake Data Cloud Connector
  4. Part 3: SQL ELT with Snowflake Data Cloud Connector
  5. Appendix A: Data type reference
  6. Appendix B: Additional runtime configurations
  7. Appendix C: Upgrading to Snowflake Data Cloud Connector

Snowflake Data Cloud Connector

Snowflake Data Cloud Connector

SQL ELT optimization types

SQL ELT optimization types

When you apply SQL ELT optimization to a mapping task, Data Integration pushes the transformation logic to the source or target database based on the optimization type you specify in the task properties. Data Integration translates the transformation logic into SQL queries or Snowflake commands to the Snowflake database based on the connection you selected.
The source or target database executes the SQL queries or Snowflake commands to process the transformations. The amount of transformation logic you can push to the database depends on the database, transformation logic, and mapping and session configuration. Data Integration processes all the transformation logic that it cannot push to a database.
You can configure the following types of SQL ELT optimization in mappings
and mappings in advanced mode
:
Full
Data Integration pushes down as much transformation logic as possible to process in the target database.
For mappings that read from and write to Snowflake, Data Integration analyses all the transformations from the source to the target. If all the transformations are compatible in the target, it pushes the entire mapping logic to the target. If it cannot push the entire mapping logic to the target, Data Integration first pushes as much transformation logic to the source database and then pushes as much transformation logic as possible to the target database.
If the source and target Snowflake accounts are separate and reside in different regions but are hosted on the same cloud platform, you can configure full SQL ELT optimization. However, ensure that the Snowflake account user and role of the target Snowflake account has access to the Snowflake source account.
Source
Data Integration pushes down as much as the transformation logic as possible to process in the source database.

0 COMMENTS

We’d like to hear from you!