Table of Contents

Search

  1. Preface
  2. Introduction to Data Engineering Streaming
  3. Data Engineering Streaming Administration
  4. Sources in a Streaming Mapping
  5. Targets in a Streaming Mapping
  6. Streaming Mappings
  7. Window Transformation
  8. Appendix A: Connections
  9. Appendix B: Monitoring REST API Reference
  10. Appendix C: Sample Files

Schema Properties

Schema Properties

You can view the schema properties in the
Data Object Operation
view of the write operation in the Developer tool.
To specify schema properties, select the data operation and enable the column projection.
The following table describes the schema properties that you configure for Microsoft Azure Data Lake Storage Gen2 targets:
Property
Description
Column Name
The name field that contains data.
This property is read-only.
Type
The native data type of the source.
This property is read-only.
Enable Column Projection
Indicates that you use a schema format.
Schema Format
The format in which the data is written. Microsoft Azure Data Lake Storage Gen2 supports JSON, Avro, and Parquet format in streaming mappings.
Schema
Specify a sample file for JSON format, a .avsc file for Avro format, or a Parquet format.
Column Mapping
The mapping of target data to the data object. Click
View
to see the mapping.