Table of Contents

Search

  1. Preface
  2. Part 1: Introduction to Amazon Redshift connectors
  3. Part 2: Data Integration with Amazon Redshift V2 Connector
  4. Part 3: Data Integration with Amazon Redshift Connector

Amazon Redshift Connectors

Amazon Redshift Connectors

Pushdown optimization using an Amazon Redshift V2 connection

Pushdown optimization using an Amazon Redshift V2 connection

You can configure pushdown optimization for a mapping that contains an Amazon Redshift V2 connection. Pushdown optimization enhances the mapping performance.
When you run a task configured for pushdown optimization, the task converts the transformation logic to Amazon Redshift queries. The task sends the queries to Amazon Redshift and the mapping logic is processed in the Amazon Redshift database.
Full pushdown optimization supports only insert operations for Amazon Redshift.
Example
You work for a rapidly growing data science organization. Your organization develops software products to analyze financials, building financial graphs connecting people profiles, companies, jobs, advertisers, and publishers. The organization uses infrastructure based on Amazon Web Services and stores its data in Amazon S3. The organization plans to implement a business intelligence service to build visualization and perform real-time analysis. You can load data from Amazon S3 to Amazon Redshift by configuring the transformations using the AWS commands, to support the adequate data warehouse model and the consuming requirements.
Create an Amazon S3 V2 connection to read data form the Amazon S3 source. Create an Amazon Redshift V2 connection and use pushdown optimization to write data to the Amazon Redshift target. Using the Amazon Redshift V2 connection with pushdown optimization enhances the performances and reduces the cost involved.