Table of Contents

Search

  1. Preface
  2. Introduction to Big Data Streaming
  3. Big Data Streaming Administration
  4. Sources in a Streaming Mapping
  5. Targets in a Streaming Mapping
  6. Streaming Mappings
  7. Window Transformation
  8. Connections
  9. Sample Files

Advanced Properties

Advanced Properties

You can use the advanced properties to specify data object write operation properties to write data to a Microsoft Azure Data Lake Store server.
The following table describes the advanced properties that you configure for a Microsoft Azure Data Lake Store write operation:
Property
Description
Tracing Level
By default, the tracing level for every transformation is Normal. Change the tracing level to a Verbose setting when you need to troubleshoot a transformation that is not behaving as expected. Set the tracing level to Terse when you want the minimum amount of detail to appear in the log.
Directory path override
Overrides the default directory path.
You must manually create a temporary active directory within the target file directory of Azure Data Lake Store connection. The temporary active directory contains the target files to which the data is currently written. After the target file reaches the specified rollover limit, the target file is closed and moved to the specified target file directory from the temporary active directory.
File name override
Overrides the default file name.
Compress newly created File
Streaming mappings do not support this property.
Maintain row order
Streaming mappings do not support this property.
If file exists
Streaming mappings do not support this property.

0 COMMENTS

We’d like to hear from you!