Data Engineering Streaming
- Data Engineering Streaming 10.5.1
- All Products
Property
| Description
|
---|---|
Column Name
| The name field that contains data.
This property is read-only.
|
Type
| The native data type of the resource.
This property is read-only.
|
Enable Column Projection
| Indicates that you use a schema to read the data that the source streams.
By default, the data is streamed in binary format. To change the format in which the data is processed, select this option and specify the schema format.
|
Schema Format
| The format in which the source processes data. You can select one of the following formats:
|
Use Schema
| Specify the XSD schema for the XML format, the sample JSON for the JSON format.
Specify a .avsc file for the Avro format or a sample file for the Flat format.
|
Use Intelligent Structure Model
| Displays the intelligent structure model associated with the complex file. You can select a different model.
You can associate the data object with an intelligent structure model and directly parse input from CSV, XML, Avro, or JSON input files.
For more information about intelligent structure models, see the
Data Engineering Integration User Guide .
|
Column Mapping
| The mapping of source data to the data object. Click
View to see the mapping.
|
Project Column as Complex Data Type
| Project columns as complex data type for sources with hierarchical data.
Select this option if the source has hierarchical data.
For more information about hierarchical data, see the Data Engineering Integration User Guide .
|