Table of Contents

Search

  1. Preface
  2. Part 1: Getting Started with Snowflake Data Cloud Connector
  3. Part 2: Data Integration with Snowflake Data Cloud Connector
  4. Part 3: SQL ELT with Snowflake Data Cloud Connector
  5. Appendix A: Data type reference
  6. Appendix B: Additional runtime configurations
  7. Appendix C: Upgrading to Snowflake Data Cloud Connector

Snowflake Data Cloud Connector

Snowflake Data Cloud Connector

Sources in mappings in SQL ELT mode

Sources in mappings in SQL ELT mode

When you configure the source connection in the Source transformation, you can choose only an Amazon S3 V2, Microsoft Azure Data Lake Storage Gen2, or a Snowflake Data Cloud connection.

Snowflake Data Cloud source properties

You can configure the following properties for a Snowflake Data Cloud source:
  • Source connection - Parameter, Allow parameter to be overridden at run time
  • Source type - Single object, multiple objects, query, and parameter. You can also use a parameter file to override the Snowflake source connections and objects in a mapping from the mapping task.
  • Allow parameter to be overridden at run time.
  • Query options - Filter and Join. You can use both simple and advanced filter conditions. You can use join to join related objects based on existing relationships or you can create an advanced relationship.
  • Database
  • Schema
  • Table name
  • SQL override

Amazon S3 V2 source properties

You can configure the following properties for an Amazon S3 V2 source:
  • Source connection parameter
  • Source Type - Single, parameter
  • Format - Delimited, Avro, ORC, Parquet, and JSON
  • Source Type - File and directory
  • Folder Path
  • File Name
  • Compression Format - Gzip
For information on how to configure the supported properties, see the Amazon S3 V2 Connector documentation.

Microsoft Azure Data Lake Storage Gen2 source properties

You can configure the following properties for a Microsoft Azure Data Lake Storage Gen2 source:
  • Source connection, connection parameter
  • Source Type - Single, parameter
  • Format - Delimited, Avro, ORC, Parquet, and JSON
  • Formatting Options
  • Filesystem Name Override
  • Source Type - File and directory
  • Directory Override - Absolute path; Relative path
  • File Name Override - Source object
  • Compression Format - Gzip to read flat files
For information on how to configure the supported properties, see the Microsoft Azure Data Lake Storage Gen2 Connector documentation.
For information on how the sources in mappings in SQL ELT mode behave differently from the sources in other types of mappings, see Sources in mappings in SQL ELT mode in
Mappings
in the Data Integration help.

0 COMMENTS

We’d like to hear from you!