Table of Contents

Search

  1. Preface
  2. Part 1: Introduction to Amazon Redshift connectors
  3. Part 2: Data Integration with Amazon Redshift V2 Connector
  4. Part 3: Data Integration with Amazon Redshift Connector

Amazon Redshift Connectors

Amazon Redshift Connectors

Pushdown optimization using the Amazon Redshift ODBC connection

Pushdown optimization using the Amazon Redshift ODBC connection

Use an ODBC connection to enable full or source pushdown optimization when you want to read data from an Amazon Redshift source, write to an Amazon Redshift target, and if you want to run the mapping logic entirely within Amazon Redshift.
When you run a task configured for pushdown optimization, the task converts the transformation logic to an SQL statement. The task sends the SQL statement to the database, and the database executes the SQL statement.
You can set the pushdown optimization for the ODBC connection type that uses Amazon ODBC Redshift drivers to enhance the mapping performance. You must create a data source name in the ODBC datasource administrator.
After you create an Amazon Redshift ODBC connection, select the value of the
Pushdown Optimization
property as
Full
or
To Source
in the advanced session properties. You can check the session log to verify that the pushdown optimization has taken place.
Amazon Redshift does not support upsert operations in a full pushdown optimization.
Example
You work for a rapidly growing data science organization. Your organization develops software products to analyze financials, building financial graphs connecting people profiles, companies, jobs, advertisers, and publishers. The organization uses infrastructure based on Amazon Web Services and stores its data in Amazon Redshift, a petabytescale data warehouse. The organization plans to implement a business intelligence service to build visualization and perform real-time analysis. Therefore, you need to port the vast amount of data stored in Amazon Redshift to the business intelligence service. You can use Amazon Redshift V2 Connector to read data from Amazon Redshift. To read this large amount of data, you can use source pushdown for the ODBC connection type. Using the ODBC connection type with pushdown optimization enhances the performance.