Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange for Amazon Redshift
  3. PowerExchange for Amazon Redshift Configuration
  4. Amazon Redshift Connections
  5. PowerExchange for Amazon Redshift Data Objects
  6. Amazon Redshift Mappings
  7. Pushdown Optimization
  8. Amazon Redshift Lookup
  9. Appendix A: Amazon Redshift Datatype Reference
  10. Appendix B: Troubleshooting

PowerExchange for Amazon Redshift User Guide

PowerExchange for Amazon Redshift User Guide

Partitioning Overview

Partitioning Overview

When you configure an Amazon Redshift mapping to read data from Amazon Redshift, you can configure partitioning to optimize the mapping performance at run time. The partition type controls how the Data Integration Service distributes data among partitions at partition points.
To configure partitioning, you must specify the value of
Maximum Parallelism
property in the Data Integration Service and on the Developer client. Specify a value greater than 1.
The following table summarizes the partition type options that you can configure for a read or write operation on the native environment:
Operation Type
Supported Partition Type
Read
You can select from the following partition types:
  • None
    . By default, the Data Integration Service creates a single partition.
  • Dynamic
    . Not applicable.
    If you select the dynamic partition type, a warning message appears and the Data Integration Service creates a single partition for the mapping to run.
  • Key Range
    . The Data Integration Service distributes rows of data based on a port or set of ports that you define as the partition key. The default number of partitions is 2.
Write
  • None
    . By default, the Data Integration Service creates a single partition.
  • Dynamic
    . By default, the Data Integration Service creates the same number of partitions for the target based on the number of partitions you specified for the source.

0 COMMENTS

We’d like to hear from you!