Data Engineering Integration
All Products
Property
| Description
|
---|---|
Enable Column Projection
| Displays the column details of the complex files sources.
|
Schema Format
| Displays the schema format that you selected while creating the complex file data object. You can change the schema format and provide respective schema.
|
Schema
| Displays the schema associated with the complex file. You can select a different schema.
If you disable the column projection, the schema associated with the complex file is removed. If you want to associate schema again with the complex file, enable the column projection and click Select Schema.
|
Column Mapping
| Displays the mapping between input and output ports.
If you disable the column projection, the mapping between input and output ports is removed. If you want to map the input and output ports, enable the column projection and click Select Schema to associate a schema to the complex file.
|
Project Column as Complex Data Type
| Displays columns with hierarchical data as a complex data type, such as, array, map, or struct. Select this property when you want to process hierarchical data on the Spark engine.
If you disable the column projection, the data type of the column is displayed as binary type.
|
Updated November 09, 2018