Preface
Part 1: Hadoop Integration
Part 2: Databricks Integration
Appendix A: Connections Reference

Integration Guide

10.4.1
- 10.5.5
- 10.5.4.1
- 10.5.4
- 10.5.3
- 10.5.2
- 10.5.1
- 10.5
- 10.4.0
- 10.2.2 HotFix 1
- 10.2.2 Service Pack 1
- 10.2.2
- 10.2.1

Back Next

Create a Staging Directory for Run-time Processing

When the Databricks Spark engine runs a job, it stores temporary files in a staging directory.

Optionally, you can create a directory on DBFS to stage temporary files during run time. By default, the Data Integration Service uses the DBFS directory at the following path:

/<cluster staging directory>/DATABRICKS

To create a directory on DBFS, see the Databricks documentation.

Before You Begin Databricks Integration

Download Guide

Watch

Comments

Communities

Knowledge Base

Success Portal

0 COMMENTS

We’d like to hear from you! Log in to comment.

Rename Saved Search

Table of Contents

Integration Guide

Integration Guide

Create a Staging Directory for Run-time Processing

Create a Staging Directory for Run-time Processing