Table of Contents

Search

  1. Preface
  2. Performance Tuning Overview
  3. Target Optimization
  4. Source Optimization
  5. Transformation Optimization
  6. Mapping Optimization
  7. Partitioned Mapping Optimization
  8. Run-time Optimization
  9. SQL Data Service Optimization
  10. Web Service Optimization
  11. Connections Optimization
  12. Data Transformation Optimization

Performance Tuning Guide

Performance Tuning Guide

Filter Optimization

Filter Optimization

You can optimize mappings by filtering within a customized data object and by placing filters early in the mapping.
Consider the following solutions for filter bottlenecks:
Use a filter in a customized data object to remove the rows at the source.
If you filter rows from the mapping, you can improve efficiency by filtering early in the data flow. Use a filter in a customized data object to remove the rows at the source. The customized data object limits the row set extracted from a relational source.
If you cannot use a filter in the customized data object, use a Filter transformation and move it as close to the customized data object as possible to remove unnecessary data early in the data flow. The Filter transformation limits the row set sent to a target.
Use a filter in an Update Strategy transformation if you do not need to keep rejected rows.
To improve mapping performance, you can also use a Filter transformation to drop rejected rows from an Update Strategy transformation if you do not need to keep rejected rows.
Avoid complex expressions in filter conditions.
Avoid using complex expressions in filter conditions. To optimize Filter transformations, use simple integer or true/false expressions in the filter condition.
The Filter transformation filters data within a mapping. The Filter transformation filters rows from any type of source. The customized data object filters rows from relational sources. The Filter transformation filters rows from any type of source.

0 COMMENTS

We’d like to hear from you!