User Guide

Back Next

Complex File Targets on Amazon S3

Use a PowerExchange for Amazon S3 connection to write data to Amazon S3 data objects.

The following table shows the complex files that a mapping can process within Amazon S3 storage in the Hadoop environment:

File Type	Supported Formats	Supported Engines
Avro	Flat Hierarchical ^{1 2}	Blaze Spark
JSON	Flat Hierarchical ^{1 2}	Blaze Spark
ORC	Flat	Spark
Parquet	Flat Hierarchical ^{1 2}	Blaze Spark
¹ To run on the Blaze engine, the complex file data object must be connected to a Data Processor transformation. ² To run on the Spark engine, the complex file write operation must be enabled to project columns as complex data type.