Databricks Connector

Back Next

Targets for Databricks

Add a Target transformation to write data to a target.

When you add a Target transformation to a mapping, you define the target connection, target objects, and target properties related to the Databricks connection type.

The following table lists the target properties that are supported by SQL warehouse, all-purpose cluster, and job cluster:

Property	SQL warehouse¹	All-purpose cluster²	Job cluster³
Source Type - Single Object	Yes	Yes	Yes
Source Type - Parameter	Yes	Yes	Yes
Object - Existing	Yes	Yes	Yes
Object - Create New at Runtime	Yes	Yes	Yes
Create target - Object Name, Table Location, Database Name	Yes	Yes	Yes
Create target - Table Properties	Yes	No	No
Operation - Insert, Update, Upsert, Delete	Yes	No	Yes
Operation - Data Driven	Yes	No	No
Target Database Name	Yes	No	Yes
Target Table Name	Yes	No	Yes
Update Override Query	Yes	No	No
Write Disposition - Append, Truncate	Yes	No	Yes
Write Disposition - Truncate Always	Yes	No	No
Update Mode - Update as update, Update else insert	Yes	No	Yes
Staging Location	Yes	No	Yes
Pre SQL	Yes	No	No
Post SQL	Yes	No	No
DTM Staging File Size	Yes	No	No
Job Timeout	No	No	Yes
Job Status Poll Interval	No	No	Yes
DB REST API Timeout	No	No	Yes
DB REST API Retry Interval	No	No	Yes
Forward Rejected Rows	Yes	No	Yes
¹The Secure Agent connects to the SQL warehouse at design time and runtime. ²The Secure Agent connects to the all-purpose cluster to import the metadata at design time. ³The Secure Agent connects to the job cluster to run the mappings.