PowerExchange for Amazon S3 User Guide

Back Next

Rules and Guidelines for Directory-Level Partitioning

Consider the following rules and guidelines when you read from and write to a partition folder:

You cannot configure directory-level partitioning when you run a mapping on the Databricks Spark engine.

You must select the file type as

Directory

to read from a partition folder.

When you import a directory that has a partition folder, the data type for the partition column is imported as a String.

You can read data from or write data to partition folders with Avro, Parquet, and ORC files.

You cannot use the

Data Preview

option with partition columns.

For

Create Target

, you can add partition fields and arrange the partition fields in an order.

When you import a data object, the data and FileName port always show 0 as the partition order.

You cannot use the FileName port when you use directory-level partitioning.

The partitioned directory that you select cannot have a partitioned column named FileName. The name is case insensitive.