Rules and Guidelines for Functions in Pushdown Optimization
Rules and Guidelines for Functions in Pushdown Optimization
Use the following rules and guidelines when pushing functions to an Amazon Redshift database:
To use pushdown optimization, you must set the value of the
Multiple Matches
Lookup transformation property to
Return all rows
.
To push TRUNC(DATE) to Amazon Redshift, you must define the date and format arguments. Otherwise, the Data Integration Service does not push the function to Amazon Redshift.
To push TO_DATE() to Amazon Redshift, you must define the string and format arguments. Otherwise, the Data Integration Service does not push the function to Amazon Redshift.
For Amazon Redshift, when you define only a string argument for TO_DATE() and TO_CHAR(), the Data Integration Service considers the default date format present in the session property. The default date format in the session property is:
MM/DD/YYYY HH24:MI:SS.US
Do not specify a format for SYSTIMESTAMP() to push the SYSTIMESTAMP to Amazon Redshift. The Amazon Redshift database returns the complete time stamp.
The aggregator functions for Amazon Redshift accept only one argument, a field set for the aggregation function. The filter condition argument is not honored. In addition, make sure that all fields mapped to the target are listed in the GROUP BY clause.
To push INSTR() to Amazon Redshift, you must only define string, search_value, and start arguments. Amazon Redshift does not support occurrence and comparison_type arguments.
The flag argument is ignored when you push TO_BIGINT and TO_INTEGER to Amazon Redshift.
The CaseFlag argument is ignored when you push IN() to Amazon Redshift.
If you use the NS format as part of the ADD_TO_DATE() function, the Data Integration Service does not push the function to Amazon Redshift.
If you use any of the following formats as part of the TO_CHAR() and TO_DATE() functions, the Data Integration Service does not push the function to Amazon Redshift:
NS
SSSS
SSSSS
RR
To push TRUNC(DATE), GET_DATE_PART(), and DATE_DIFF() to Amazon Redshift, you must use the following formats:
D
HH24
MI
MM
MS
SS
US
YYYY
To push GET_DATE_PART() to Amazon Redshift, you must use the following formats: