Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange for Microsoft Azure Data Lake Storage Gen2
  3. PowerExchange for Microsoft Azure Data Lake Storage Gen2 Configuration
  4. Microsoft Azure Data Lake Storage Gen2 Connections
  5. PowerExchange for Microsoft Azure Data Lake Storage Gen2 Data Objects
  6. Microsoft Azure Data Lake Storage Gen2 Mappings
  7. Appendix A: Microsoft Azure Data Lake Storage Gen2 Datatype Reference

PowerExchange for Microsoft Azure Data Lake Storage Gen2 User Guide

PowerExchange for Microsoft Azure Data Lake Storage Gen2 User Guide

Schema Properties

Schema Properties

The Developer tool displays schema properties for intelligent structure model, Avro, JSON, and Parquet complex file sources in the
Data Object Operations Details
window.
The following table describes the schema properties that you configure for the complex file sources:
Property
Description
Column Name
Displays the name of the column.
Column Type
Displays the format of the column.
Enable Column Projection
Displays the column details of the complex files sources.
Schema Format
Displays the schema format that you selected while creating the complex file data object. You can change the schema format. You can also parameterize the schema format.
You can select one of the following options:
  • Flat
  • Avro
  • JSON
  • ORC
  • Parquet
  • Intelligent Structure Model
When you read an empty JSON file, the Data Integration Service does not generate headers in the target data.
You can change the complex file format without losing the column metadata even after you configure the schema properties for another complex file format.
You can switch from one schema format to another only once. If you change the schema format more than once, you might lose the original datatypes.
Schema
Displays the schema associated with the complex file. You can select a different schema. You can parameterize the schema or the schema path.
To parameterize the schema path, obtain the path from the server. To parameterize schema or schema path for flat files, provide the schema in the same format in which the flat file is imported in the Developer Client.
When you use Refresh Schema for the source or target in a mapping and also, parameterize the schema, the parameterized schema takes precedence over the refresh schema.
If you disable the column projection, the schema associated with the complex file is removed. If you want to associate schema again with the complex file, enable the column projection and select schema.
Schema Properties
Applicable only to flat files.
Column Mapping
Displays the mapping between input and output ports.
If you disable the column projection, the mapping between input and output ports is removed. If you want to map the input and output ports, enable the column projection and click
Select Schema
to associate a schema to the complex file.

0 COMMENTS

We’d like to hear from you!