You can stage data in a Volume in
Databricks. Volumes are Unity Catalog objects used to manage and secure non-tabular datasets
such as files and directories.
You can use a Volume on a Linux or Windows machine and with
the Databricks JDBC driver.
To use a Volume, complete the following
prerequisites:
Ensure that your Databricks workspace is
enabled for Unity Catalog.
Get the path where you want to stage the
data in a Volume. If you do not specify a volume path in the Databricks connection
properties, the Secure Agent creates a managed volume in Databricks, which is
automatically deleted once the job is completed. Ensure you have the create and delete
permissions for the managed volume if you do not want to specify a path.