Databricks Connector

Back Next

Advanced settings

The following table describes the advanced connection properties:

Property	Description
Database	The name of the schema in Databricks. The name can contain only alphanumeric characters and hyphen (-). This property is optional for SQL warehouse, all-purpose cluster, and job cluster. If you do not specify a value, all databases available in the workspace are listed. The value you specify overrides the schema specified in the SQL Warehouse JDBC URL connection property.
JDBC Driver Class Name	The name of the JDBC driver class. This property is optional for SQL warehouse, all-purpose cluster, and job cluster. Default is com.databricks.client.jdbc.Driver
Staging Environment	The staging environment where your data is temporarily stored before processing. This property is required for SQL warehouse, all-purpose cluster, and job cluster. Select one of the following options as the staging environment: AWS. If Databricks is hosted on the AWS platform. Azure. If Databricks is hosted on the Azure platform. Personal Staging Location¹. To stage data in a local personal storage location. Volume¹. To stage data in a volume in Databricks. Volumes are Unity Catalog objects used to manage and secure non-tabular datasets such as files and directories. When you configure a Databricks connection to connect to Databricks endpoints hosted on Google Cloud Platform, you must use a volume to stage data. Both volume and personal staging location do not apply to all-purpose clusters and job clusters. Default is Volume. You cannot switch between clusters after you establish a connection. Effective in the October 2024 release, personal staging location is deprecated. Deprecated functionality is supported, but Informatica intends to drop support in a future release. Informatica requests that you use a volume to stage the data.
Volume Path	The absolute path in Volume where you want to stage the data temporarily. Specify the path in the following format: /Volumes/<catalog_identifier>/<schema_identifier>/<volume_identifier>/ If you do not specify a volume path, the Secure Agent creates a managed volume in Databricks.
¹Doesn't apply to mappings in advanced mode.