Search

PowerExchange for Amazon S3 User Guide

PowerExchange for Amazon S3 User Guide

10.4.1
- 10.5.9
- 10.5.8
- 10.5.7
- 10.5.6
- 10.5.5
- 10.5.4
- 10.5.3
- 10.5.2
- 10.5.1
- 10.5
- 10.4.0

Back Next

Schema Properties

Schema Properties

The Developer tool displays the column projection properties for Amazon S3 file targets in the

Data Object Operations Details

window.

The following table describes the schema properties that you configure for Amazon S3 file targets:

Property	Description
Column Name	Displays the name of the column.
Column Type	Displays the format of the column.
Enable Column Projection	Displays the column details of the complex files sources.
Schema Format	Displays the schema format that you selected while creating the complex file data object. You can change the schema format. You can also parameterize the schema format. You can select one of the following Amazon S3 file formats when you run the mapping in the native environment or on the Spark and Databricks Spark engine: Flat Avro ORC Parquet You can select the JSON Amazon S3 file format when you run the mapping only on the Spark or Databricks Spark engine. You can change the complex file format without losing the column metadata even after you configure the column projection properties for another complex file format. You can switch from one schema format to another only once. If you change the schema format more than once, you might lose the original datatypes.
Schema	Displays the schema associated with the complex file. You can select a different schema. You can parameterize the schema or the schema path. For more information, see Specifying the schema file format. To parameterize the schema path, obtain the path from the server. When you use Refresh Schema for the source or target in a mapping and also, parameterize the schema, the parameterized schema takes precedence over the refresh schema. If you disable the column projection, the schema associated with the complex file is removed. If you want to associate schema again with the complex file, enable the column projection and select schema.
Schema Properties	Applicable only to flat files.
Column Mapping	Displays the mapping between input and output ports. If you disable the column projection, the mapping between input and output ports is removed. If you want to map the input and output ports, enable the column projection and click Select Schema to associate a schema to the complex file.

Amazon S3 Data Object Write Operation

Specifying the schema file format

Flat File Schema Properties

Watch

Comments

0 COMMENTS

We’d like to hear from you! Log in to comment.