Table of Contents

Search

  1. Preface
  2. Introduction to Data Engineering Streaming
  3. Data Engineering Streaming Administration
  4. Sources in a Streaming Mapping
  5. Targets in a Streaming Mapping
  6. Streaming Mappings
  7. Window Transformation
  8. Appendix A: Connections
  9. Appendix B: Monitoring REST API Reference
  10. Appendix C: Sample Files

Schema Properties

Schema Properties

The schema properties display the column related details of the Google Cloud Storage targets. To specify schema properties, select the data operation and enable the column projection.
The following table describes the schema properties that you configure for Google Cloud Storage targets:
Property
Description
Column Name
Name field that contains data.
This property is read-only.
Column Type
Native data type of the source.
This property is read-only.
Enable Column Projection
Indicates that you use a schema format to write the data.
Schema Format
The format in which the data is written. Select one of the following formats:
  • Avro
  • JSON
  • Parquet
When you run mappings on the Spark engine, you cannot write data to Google Cloud Storage in binary or flat file format.
Schema
Specify .avsc file for Avro format, sample file for JSON, or Parquet file format.
Column Mapping
Mapping of target data to the data object. Click
View
to see the mapping.