Microsoft Azure Data Lake Storage Gen2 Connector

Back Next

Configuring Delta file format

You can use the Delta file format in mappings and mappings in advanced mode.

Before you use the Delta file format in mappings in advanced mode, perform the following steps:

In the mapping task, navigate to the

Advanced Session Properties

section on the

Runtime Options

tab.

Under Advanced Session Properties
, click

and select

spark.custom.property

in the Session Property Name
field.

In the Session Property Value
field, set the following values:

spark.sql.extensions=io.delta.sql.DeltaSparkSessionExtension

spark.sql.catalog.spark_catalog=org.apache.spark.sql.delta.catalog.DeltaCatalog

Separate the values with &:
in the Session Property Value
field.

Watch

Comments

0 COMMENTS

We’d like to hear from you! Log in to comment.