Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Ask INFA.

Configuring pushdown optimization for Snowflake using the ODBC Connector

Configuring pushdown optimization for Snowflake using the ODBC Connector

Target transformation

Target transformation

You can use an existing Snowflake target or create a Snowflake target to write data. The update override target property is not applicable in a target operation.
When you configure a mapping to write data, you might need to set the following configurations based on your use case:
Not Null constraint
When you define the primary key for the target table, you must explicitly define the Not Null constraint. Mappings that upsert, delete, or update data fail when you do not add the Not Null constraint for the target table. You can add the Not Null constraint and rerun the mapping.
Create views
You must enable the
Create Temporary View
property in the session properties of the mapping task when the Target transformation is configured to upsert, update, or delete data in Snowflake.
When you configure a mapping to create a new target at runtime, you might need to set the following configurations based on your use case:
SQL identifiers
To handle quotes, you must explicitly enable the AddQuotesAlwaysPDO flag and set the value to Yes in the custom properties in the advanced session properties of the mapping task .
Truncate a target
If you specify the truncate target option in the target mapping, add the
AddQuotesAlways
DTM property and set the value to
Yes
in the Secure Agent custom configuration details. However, mappings fail when you attempt to truncate a Snowflake target that contains special characters.

Restrictions

A mapping that creates a new target at runtime for pushdown optimization has the following restrictions:
  • The TIMESTAMP_LTZ, TIMETAMP_TZ, Boolean, and Time data types are not applicable.
  • If you drop the target created on Snowflake using the drop table tablename command, and rerun the same mapping, Data Integration does not create the target. It does not trigger the create query and results in an error.
  • If the name you specify for the target already exists in Snowflake, Data Integration inserts the data to the existing target table. If you delete the created target table and re-run the mapping task, the Secure Agent fails to create the target table.

0 COMMENTS

We’d like to hear from you!