Table of Contents

Search

  1. Preface
  2. Introduction to Databricks Delta Connector
  3. Connections for Databricks Delta
  4. Mappings for Databricks Delta
  5. Migrating a mapping
  6. Databricks Delta SQL ELT optimization
  7. Data type reference

Databricks Delta Connector

Databricks Delta Connector

Targets for Databricks Delta

Targets for Databricks Delta

Add a Target transformation to write data to a target.
When you add a Target transformation to a mapping, you define the target connection, target objects, and target properties related to the Databricks Delta connection type.
The following table lists the target properties that are supported by SQL warehouse and Databricks cluster:
Property
SQL warehouse
Databricks cluster
Source Type - Single Object
Yes
Yes
Source Type - Parameter
Yes
Yes
Object - Existing
Yes
Yes
Object - Create New at Runtime
Yes
Yes
Create target - Object Name, Table Location, Database Name
Yes
Yes
Create target - Table Properties
Yes
No
Operation - Insert, Update, Upsert, Delete
Yes
Yes
Target Database Name
Yes
Yes
Target Table Name
Yes
Yes
Update Override Query
Yes
No
Write Disposition - Append, Truncate
Yes
Yes
Write Disposition - Truncate Always
Yes
No
Update Mode - Update as update, Update else insert
Yes
Yes
Staging Location
Yes
Yes
Pre SQL
Yes
No
Post SQL
Yes
No
DTM Staging File Size
Yes
No
Job Timeout
No
Yes. Applies only to job cluster.
Job Status Poll Interval
No
Yes. Applies only to job cluster.
DB REST API Timeout
No
Yes. Applies only to job cluster.
DB REST API Retry Interval
No
Yes. Applies only to job cluster.
Forward Rejected Rows
Yes
Yes

0 COMMENTS

We’d like to hear from you!