Snowflake Data Cloud Connector

Back Next

Verify the SQL ELT query in the session log

To verify that the SQL ELT optimization was applied while running the mapping, you can check the session log for the job. In Monitor, view the log for jobs.

Check the queries in the session logs to verify if the mapping applied SQL ELT optimization.

For example, the following query is generated in the session log for a mapping enabled with full SQL ELT optimization:

In the example, the generated SQL includes both the

Insert Into

and

Select

queries pushed down to the database as a single statement.

The session log provides the SQL ELT status. You can check the details to troubleshoot the error.

For example, the session log shows the following error details in the query:

When you do not enable SQL ELT optimization in a mapping, separate select and insert statements are generated for the read and write operations:

READER_1_1_1>SNOWFLAKECLOUDDATAWAREHOUSE_1000 [2020-09-10 14:09:29.4781] [INFO] 
The Snowflake Connector uses the following SQL query to read data: SELECT "DEPTID", "DEPTNAME" FROM "DEPT" WHERE 
( 'DEPT"."DEPTID" >=103) ORDER BY "DEPT"."DEPTOD" desc

When you enable SQL ELT optimization in a mapping in advanced mode, use the following sample query to read from and write to Snowflake:

INSERT INTO "DB_PC_AUTO"."SCHEMA_PC_AUTO"."ALL_DATA_TYPES_TARGET"("ID") 
     SELECT 
            ALL_0."ID" as c0
     FROM "DB_PC_AUTO"."SCHEMA_PC_AUTO"."ALL_DATA_TYPES"
      AS ALL_0

Rename Saved Search

Table of Contents

Snowflake Data Cloud Connector

Snowflake Data Cloud Connector

Verify the SQL ELT query in the session log

Verify the SQL ELT query in the session log