Preface
Introducing INFACore SDK for Python
- INFACore SDK Reference for Python
Setting up the runtime environment
- Configure a remote agent
- Configure a local agent
Databricks integration with INFACore
Databricks integration with INFACore using Databricks Connect
Microsoft Fabric integration with INFACore
Reusing user-defined functions
- UDF scope and requirements
Reusing data pipelines
- Mapping template scope and requirements
Troubleshooting using INFACore log files

INFACore SDK for Python

Back Next

Set up the Databricks cluster

Set up the Databricks cluster for use with Databricks Connect. Databricks Connect runs your jobs remotely on a Databricks cluster using Spark APIs. The Databricks cluster must be using Databricks Runtime version 5.1 or later.

In the compute configuration of the Databricks cluster, go to the advanced options.

Edit the Spark configuration section and enter the following code snippet:

spark.databricks.service.server.enabled true

Enter the following code snippet, based on whether you want to use AWS Databricks or Azure Databricks:

To use AWS Databricks, enter the following code snippet:

spark.databricks.service.port 15001

To use Azure Databricks, enter the following code snippet:

spark.databricks.service.port 8787

Rename Saved Search

Table of Contents

INFACore SDK for Python

INFACore SDK for Python

Set up the Databricks cluster

Set up the Databricks cluster