Connectors and Connections

Back Next

Before you begin

You can use a Databricks connection to read from and write to Databricks tables.

You can configure the following compute resources to connect to Databricks:

SQL warehouse (Recommended)

The Secure Agent connects to the SQL warehouse at design time and runtime.

All-purpose cluster and job cluster

The Secure Agent connects to the all-purpose cluster to import the metadata at design time and to the job cluster to run the mappings.

If you're using an all-purpose or job cluster, Informatica recommends transitioning to the SQL warehouse. The all-purpose and job clusters will no longer receive new feature updates or enhancements, although they will still receive critical security updates to maintain their stability and safety. By switching to the SQL warehouse, you will benefit from the latest features and enhancements.

Before you get started, you'll need to configure the AWS or Azure staging environment to use Databricks connection.

To learn about prerequisites for the Azure or AWS environment, check out Staging prerequisites.

Connect to Databricks

Download Guide

Watch

Comments

Cloud Mass Ingestion Homepage