Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange for Amazon Redshift
  3. PowerExchange for Amazon Redshift Configuration
  4. Amazon Redshift Sources and Targets
  5. Amazon Redshift Mappings
  6. Amazon Redshift Pushdown Optimization
  7. Amazon Redshift Sessions
  8. Appendix A: Amazon Redshift Data Type Reference
  9. Appendix B: Troubleshooting

PowerExchange for Amazon Redshift User Guide for PowerCenter

PowerExchange for Amazon Redshift User Guide for PowerCenter

Working with Large Tables

Working with Large Tables

You can upload or download a large object as a set of multiple independent parts.
PowerExchange for Amazon Redshift uses the AWS TransferManager API to upload a large object in multiple parts to Amazon S3. While downloading a large object, the PowerCenter Integration Service downloads the object in multiple parts from the Amazon S3.
When the file size is more than 5 MB, you can configure multipart upload to upload object in multiple parts in parallel. You can choose to download the object in multiple parts in parallel when the file size of an Amazon S3 object is greater than 12 MB. You can configure the
Part Size
and
TransferManager Thread Pool Size
options in the target session properties.

0 COMMENTS

We’d like to hear from you!