User Guide

10.2.2 HotFix 1
- 10.5.7
- 10.5.6
- 10.5.5
- 10.5.4
- 10.5.3
- 10.5.2
- 10.5.1
- 10.5
- 10.4.1
- 10.4.0
- 10.2.2 Service Pack 1
- 10.2.2
- 10.2.1

Back Next

Complex File Targets on ADLS

You can use a PowerExchange for HDFS or a PowerExchange for Microsoft Azure Data Lake Store connection to write data to ADLS data objects. If you use a PowerExchange for Microsoft Azure Data Lake Store connection, you cannot write compressed binary files to ADLS.

The following table shows the complex files that a PowerExchange for Microsoft Azure Data Lake Store connection can process within ADLS storage in the Hadoop environment:

File Type	Supported Formats	Supported Engines
Avro	Flat Hierarchical ¹	Spark
JSON	Flat Hierarchical ¹	Spark
Parquet	Flat Hierarchical ¹	Spark
¹ To run on the Spark engine, the complex file write operation must be enabled to project columns as complex data type.

The following table shows the complex files that a PowerExchange for HDFS connection can process within ADLS storage in the Hadoop environment:

File Type	Supported Formats	Supported Engines
Avro	Flat Hierarchical ^{1 2}	Blaze Spark
JSON	Flat¹ Hierarchical ^{1 2}	Blaze Spark
ORC	Flat	Spark
Parquet	Flat Hierarchical ^{1 2}	Blaze Spark
¹ To run on the Blaze engine, the complex file data object must be connected to a Data Processor transformation. ² To run on the Spark engine, the complex file write operation must be enabled to project columns as complex data type.

Rename Saved Search

Table of Contents

User Guide

User Guide

Complex File Targets on ADLS

Complex File Targets on ADLS