PowerExchange for Amazon S3 User Guide

10.5.6
- 10.5.9
- 10.5.8
- 10.5.7
- 10.5.5
- 10.5.4
- 10.5.3
- 10.5.2
- 10.5.1
- 10.5
- 10.4.1
- 10.4.0

Back Next

Specifying the schema file format

You can override the default schema and specify the schema for Flat, Avro, ORC, and Parquet files. Specify the schema in the following formats:

Flat

{"FileName":"<FilePath>\\<FileName>","Columns":[{"Type":"number","Precision":2,"Scale":0,"Name":"N_NATIONKEY"},{"Type":"string","Precision":14,"Scale":0,"Name":"N_NAME"},{"Type":"number","Precision":1,"Scale":0,"Name":"N_REGIONKEY"},{"Type":"string","Precision":112,"Scale":0,"Name":"N_COMMENT"}]}

Avro

 {"type":"record","name":"InfaRecord","fields":[{ "name":"C_CUSTKEY" , "type":[{"type":"bytes","logicalType":"decimal","precision":3,"scale":0},"null"]} , { "name":"C_NAME" , "type": ["string", "null"] } , { "name":"C_ADDRESS" , "type": ["string", "null"] } , { "name":"C_PHONE" , "type": ["string", "null"] } , { "name":"C_ACCTBAL" , "type": ["string", "null"] } , { "name":"C_MKTSEGMENT" , "type": ["string", "null"] } , { "name":"C_COMMENT" , "type": ["string", "null"] }]}

ORC

message AmazonS3_Data_Object { optional   INT32 C_CUSTKEY (DECIMAL(3,0));optional binary C_NAME (UTF8);optional binary C_ADDRESS (UTF8);optional   INT32 C_NATIONKEY (DECIMAL(2,0));optional binary C_COMMENT (UTF8); }

Parquet

message S3_Parquet_1_Level { optional   INT32 C_CUSTKEY (DECIMAL(3,0));optional binary C_NAME (UTF8);optional binary C_ADDRESS (UTF8);optional binary C_PHONE (UTF8);optional binary C_ACCTBAL (UTF8);optional binary C_MKTSEGMENT (UTF8);optional binary C_COMMENT (UTF8); }

Rename Saved Search

Table of Contents

PowerExchange for Amazon S3 User Guide

PowerExchange for Amazon S3 User Guide

Specifying the schema file format

Specifying the schema file format