Table of Contents

Search

  1. Preface
  2. Part 1: Getting Started with Snowflake Data Cloud Connector
  3. Part 2: Data Integration with Snowflake Data Cloud Connector
  4. Part 3: SQL ELT with Snowflake Data Cloud Connector
  5. Appendix A: Data type reference
  6. Appendix B: Additional runtime configurations
  7. Appendix C: Upgrading to Snowflake Data Cloud Connector

Snowflake Data Cloud Connector

Snowflake Data Cloud Connector

Source properties for Snowflake Data Cloud

Source properties for Snowflake Data Cloud

In a mapping, you can configure a Source transformation to represent a Snowflake Data Cloud source.
The following table describes the Snowflake Data Cloud source properties that you can configure in a Source transformation:
Property
Description
Connection
Name of the source connection.
You can select an existing connection, create a new connection, or define parameter values for the source connection property.
You can switch between a non-parameterized and a parameterized Snowflake Data Cloud connection. The advanced property values are retained during the switch.
If you want to overwrite the source connection properties at runtime, select the
Allow parameter to be overridden at run time
option.
Specify the parameter file directory and name in the advanced session properties.
Source Type
Type of the source object.
Select Single Object, Multiple Objects, Query, or Parameter.
Parameter
A parameter file where you define values that you want to update without having to edit the task.
Select an existing parameter for the source object, or click
New Parameter
to define a new parameter for the source object.
The
Parameter
property appears only if you select parameter as the source type.
If you want to overwrite the parameter at runtime, select the
Allow parameter to be overridden at run time
option when you create a parameter. When the task runs, it uses the parameters from the file that you specify in the task advanced session properties.
Object
The source object for the task.
Select the source object for a single source. When you select the multiple source option, you can add multiple source objects and configure a relationship between them.
Filter
Filters records based on the filter condition.
You can specify a simple filter or an advanced filter.
Sort
Sorts records based on the conditions you specify.
You can specify the following sort conditions:
  • Not parameterized. Select the fields and type of sorting to use.
  • Parameterized. Use a parameter to specify the sort option.
Select Distinct Rows Only
1
Extracts distinct rows from the source table.
If you select the source type as query or you specify the SQL query property, the Select Distinct option is ignored
1
Doesn't apply to mappings in advanced mode.
The following table describes the advanced properties that you can configure in a Source transformation:
Advanced Property
Description
Database
Overrides the database specified in the connection.
Schema
Overrides the schema specified in the connection.
Warehouse
Overrides the Snowflake warehouse name specified in the connection.
Role
Overrides the Snowflake role assigned to user you specified in the connection.
The warehouse name in the mapping overrides the warehouse name you specify in the connection. Even though you provide an incorrect warehouse name in the connection properties, the connection is successful. However, before you run the mapping, ensure that you specify the correct warehouse name in the mapping properties.
Pre SQL
The pre-SQL command to run on the Snowflake source table before the agent reads the data.
For example, if you want to update records in the database before you read the records from the table, specify a pre-SQL statement.
The query must include a fully qualified table name. You can specify multiple pre-SQL commands, each separated with a semicolon.
Post SQL
The post-SQL command to run on the Snowflake table after the agent completes the read operation.
For example, if you want to delete some records after the latest records are loaded, specify a post-SQL statement.
The query must include a fully qualified table name. You can specify multiple post-SQL commands, each separated with a semicolon.
Table Name
Overrides the table name of the imported Snowflake source table.
SQL Override
The SQL statement to override the default query used to read data from the Snowflake source.
Tracing Level
Determines the amount of detail that appears in the log file. You can select Terse, Normal, Verbose Initialization, or Verbose Data. Default value is Normal.

0 COMMENTS

We’d like to hear from you!