Table of Contents

Search

  1. Preface
  2. Introduction to Data Engineering Streaming
  3. Data Engineering Streaming Administration
  4. Sources in a Streaming Mapping
  5. Targets in a Streaming Mapping
  6. Streaming Mappings
  7. Transformation in Streaming Mappings
  8. Window Transformation
  9. Appendix A: Connections
  10. Appendix B: Monitoring REST API Reference
  11. Appendix C: Sample Files

Advanced Properties

Advanced Properties

You can use the advanced properties to specify data object write operation properties to write data to a Microsoft Azure Data Lake Store server.
The following table describes the advanced properties that you configure for a Microsoft Azure Data Lake Store write operation:
Property
Description
Tracing Level
By default, the tracing level for every transformation is Normal. Change the tracing level to a Verbose setting when you need to troubleshoot a transformation that is not behaving as expected. Set the tracing level to Terse when you want the minimum amount of detail to appear in the log.
Directory path override
Overrides the default directory path.
You must manually create a temporary active directory within the target file directory of Azure Data Lake Store connection. The temporary active directory contains the target files to which the data is currently written. After the target file reaches the specified rollover limit, the target file is closed and moved to the specified target file directory from the temporary active directory.
File name override
Overrides the default file name.
Compress newly created File
Not applicable for streaming mappings.
Maintain row order
Not applicable for streaming mappings.
If file exists
Not applicable for streaming mappings.
Interim Directory
The active directory location of the complex file target. This directory stages all the files currently in open state. When the stream rollover condition is met, the files are moved from the interim directory to the target directory.

0 COMMENTS

We’d like to hear from you!