PowerExchange for Amazon Redshift User Guide

10.5.6
- 10.5.9
- 10.5.8
- 10.5.7
- 10.5.4
- 10.5.3
- 10.5.2
- 10.5
- 10.4.1
- 10.4.0

Back Next

Partitioning Overview

When you configure an Amazon Redshift mapping to read data from Amazon Redshift, you can configure partitioning to optimize the mapping performance at run time. The partition type controls how the Data Integration Service distributes data among partitions at partition points.

To configure partitioning, you must specify the value of

Maximum Parallelism

property in the Data Integration Service and on the Developer client. Specify a value greater than 1.

The following table summarizes the partition type options that you can configure for a read or write operation on the native environment:

Operation Type	Supported Partition Type
Read	You can select from the following partition types: None . By default, the Data Integration Service creates a single partition. Dynamic . Not applicable. If you select the dynamic partition type, a warning message appears and the Data Integration Service creates a single partition for the mapping to run. Key Range . The Data Integration Service distributes rows of data based on a port or set of ports that you define as the partition key. The default number of partitions is 2.
Write	None . By default, the Data Integration Service creates a single partition. Dynamic . By default, the Data Integration Service creates the same number of partitions for the target based on the number of partitions you specified for the source.

Operation Type

Supported Partition Type

Read

You can select from the following partition types:

None
. By default, the Data Integration Service creates a single partition.

Dynamic
. Not applicable.

If you select the dynamic partition type, a warning message appears and the Data Integration Service creates a single partition for the mapping to run.

Key Range
. The Data Integration Service distributes rows of data based on a port or set of ports that you define as the partition key. The default number of partitions is 2.

Write

None
. By default, the Data Integration Service creates a single partition.

Dynamic
. By default, the Data Integration Service creates the same number of partitions for the target based on the number of partitions you specified for the source.

Amazon Redshift Mappings

Key Range Partitioning

Dynamic Partitioning

Download Guide

Watch

Comments

Communities

Knowledge Base

Success Portal