Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Ask INFA.

Table of Contents

Search

  1. Preface
  2. Introduction to Databricks Connector
  3. Connections for Databricks
  4. Mappings for Databricks
  5. Migrating a mapping
  6. SQL ELT with Databricks Connector
  7. Data type reference
  8. Troubleshooting

Databricks Connector

Databricks Connector

Supported features for Amazon S3 V2 source

Supported features for Amazon S3 V2 source

When you configure
SQL ELT optimization
, the mappings support the following properties for an Amazon S3 V2 source:
  • Source connection parameter
  • Source Type - Single, query
  • Parameter
  • Format - Avro, ORC, Parquet, JSON, CSV, and Delta
  • Source Type - File and directory. XML source type is not applicable.
  • Folder Path
  • File Name
When you configure
SQL ELT optimization
, the mapping supports the following transformations:
  • Filter
  • Expression
  • Aggregator
  • Sorter
  • Router
  • Joiner
  • Lookup
  • Union
  • Rank
For information on how to configure the supported properties, see the Amazon S3 V2 Connector documentation.

0 COMMENTS

We’d like to hear from you!