When you configure the source connection in the Source transformation, you can choose
an Amazon S3 V2, Databricks, Google Cloud Storage, or Microsoft Azure Data Lake Storage Gen2
connection.
Amazon S3 V2 source properties
You can configure the following properties for an Amazon S3 V2 source:
Source connection - Parameter, Allow parameter to be overridden at run time
Source Type - Single, Parameter
Format - Delimited, Avro, JSON, ORC, Parquet, and
Delta
Source Type - File and directory
Folder Path
File Name
Edit Metadata
You can edit the precision
and scale only for fields of the Decimal data type.
For information on how to configure the supported properties, see the Amazon S3 V2 Connector documentation.
Databricks source properties
You can configure the following properties for a Databricks source:
Source connection - Parameter, Allow parameter to be overridden at run time
Source Type - Single, query, parameter
Database Name
Table Name
SQL Override
Google Cloud Storage source properties
You can configure the following properties for a Google Cloud Storage source:
Source connection - Parameter,
Allow parameter to be overridden at run time
Source Type - Single, Parameter
Format - Delimited, Avro, JSON, ORC, and
Parquet
Google Cloud Storage Path
Source File Name
Is Directory
Edit Metadata
You can edit the precision
and scale only for fields of the Decimal data type.
For information on how to configure the supported
properties, see the Google Cloud Storage V2 Connector documentation.
Microsoft Azure Data Lake Storage Gen2 source properties
You can configure the following properties for a Microsoft Azure Data Lake Storage Gen2 source:
Source connection - Parameter, Allow parameter to be overridden at run time
Source Type - Single, Parameter
Format - Delimited, Avro, JSON, ORC, Parquet, and
Delta
Filesystem Name Override
Source Type - File and directory
Allow Wildcard Characters
Directory Override
File Name Override
Edit Metadata
You can edit the precision
and scale only for fields of the Decimal data type.
For information on how to configure the supported properties, see the Microsoft Azure Data Lake Storage Gen2 Connector documentation.
ASK INFAPreview
