Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange for Microsoft Azure Blob Storage
  3. PowerExchange for Microsoft Azure Blob Storage Configuration
  4. Microsoft Azure Blob Storage Connections
  5. Microsoft Azure Blob Storage Data Objects
  6. Microsoft Azure Blob Storage Mappings
  7. Data Type Reference

PowerExchange for Microsoft Azure Blob Storage User Guide

PowerExchange for Microsoft Azure Blob Storage User Guide

Column Projection Properties

Column Projection Properties

The Developer tool displays the column projection properties for Avro, JSON, and Parquet complex file targets in the Properties view of the
Write
operation.
The following table describes the advanced properties that you configure for Avro, JSON, and Parquet complex file targets:
Property
Description
Enable Column Projection
Displays the column details of the complex files sources.
Use Schema
Enables the schema selection for the complex file. You can select a different schema.
If you disable the column projection, the schema associated with the complex file is removed. If you want to associate schema again with the complex file, enable the column projection and click
Add Schema
.
Schema Format
Displays the schema format that you selected while creating the complex file data object. You can change the schema format and provide respective schema.
Use Intelligent Structure Model
Not applicable for the data object write operation.
Model
Not applicable for the data object write operation.
Column Mapping
Displays the mapping between input and output ports.
If you disable the column projection, the mapping between input and output ports is removed. If you want to map the input and output ports, enable the column projection and click
Select Schema
to associate a schema to the complex file.
Project Column as Complex Data Type
Displays columns with hierarchical data as a complex data type, such as, array, map, or struct. Select this property when you want to process hierarchical data on the Spark engine.
If you disable the column projection, the data type of the column is displayed as binary type.