By default, the tracing level for every transformation is Normal. Change the tracing level to a Verbose setting when you need to troubleshoot a transformation that is not behaving as expected. Set the tracing level to Terse when you want the minimum amount of detail to appear in the log.

Not applicable

Number of concurrent connections to write data to

Microsoft Azure Data Lake Storage Gen2

. When writing a large file or object, you can spawn multiple threads to process data. Configure

Block Size

to partition a large file into smaller parts. Default is 10.

Overrides the default file system name.

Overrides the default directory path. You can specify an absolute or a relative directory path.

Absolute path. The Data Integration Service searches this directory path in the specified file system. Example of absolute path:
Dir1/Dir2
Relative path: The Data Integration Service searches this directory path in the native directory path of the object. Example of relative path:
/Dir1/Dir2

Overrides the file name.

If the target exists, overwrites or appends the data to the existing file. You can also configure the mapping to fail if the target already exists.

Partitions a large file or object into smaller parts each of specified block size. When writing a large file, consider partitioning the file into smaller parts and configure

Concurrent Threads

to spawn required number of threads to process data in parallel.

Compresses data when you write data to

Microsoft Azure Data Lake Storage Gen2

. You can compress the data in the following formats:

None. No compression format.
Gzip. Applicable only to flat files. The target file extension must be
.GZ
.
Snappy. Applicable only to Avro, ORC, and Parquet file formats in
Microsoft Azure Data Lake Storage Gen2
.

The number of seconds to wait when attempting to connect to the server. A timeout will occur if the connection cannot be established in the specified amount of time. Default is 0.

Not applicable.

Not applicable.

Not applicable.

Select one of the following partition options when you configure a dynamic mapping on the Spark engine:

None. Partitioning is not configured.
Last N Columns Partitioned. The last N columns are selected for partitioning.
Partition Column Names. Comma-separated column names are selected for partitioning.

The number or names of partition columns.