Data Ingestion and Replication
- Data Ingestion and Replication
- All Products
Property
| Description
|
---|---|
Connection Name
| Name of the connection.
Each connection name must be unique within the organization. Connection names can contain alphanumeric characters, spaces, and the following special characters: _ . + -,
Maximum length is 255 characters.
|
Description
| Description of the connection. Maximum length is 4000 characters.
|
Type
| Databricks
|
Runtime Environment
| The name of the runtime environment where you want to run tasks.
For application ingestion and replication
initial load tasks and database ingestion and replication tasks that have a supported
source type, you can use the serverless runtime environment. You
cannot run an application ingestion and replication , a database ingestion and replication , or a streaming ingestion and replication task on a Hosted Agent or
elastic runtime environment. |
SQL Warehouse JDBC URL
| Databricks SQL Warehouse JDBC connection URL.
This property is required only for Databricks SQL warehouse. Doesn't apply to all-purpose cluster and job cluster.
To get the SQL Warehouse JDBC URL, go to the Databricks console and select the JDBC driver version from the JDBC URL menu.
Application ingestion and replication and
database ingestion and replication tasks can use JDBC URL version
2.6.25 or later or
2.6.22 or earlier . The URLs must begin with the prefix
jdbc:databricks:// , as follows:
jdbc:databricks://<Databricks Host>:443/default;transportMode=http;ssl=1;AuthMech=3;httpPath=/sql/1.0/endpoints/<SQL endpoint cluster ID>;
Ensure that you set the required environment variables in the Secure Agent. Also specify the correct
JDBC Driver Class Name under advanced connection settings.
Specify the database name in the Database Name connection property. If you specify the database name in the JDBC URL, it is not considered.
|