Table of Contents

Search

  1. Preface
  2. Introduction to Data Validation Option
  3. New Features and Behavior Changes
  4. Repositories
  5. XML Data Source
  6. Tests for XML Data Sources
  7. Connections
  8. Expressions
  9. Table Pairs
  10. Tests for Table Pairs
  11. Single-Table Constraints
  12. Tests for Single-Table Constraints
  13. Examples of Tests from Spreadsheets
  14. SQL Views
  15. Lookup Views
  16. Join Views
  17. Aggregate Views
  18. Business Intelligence and Reporting Tools Reports
  19. Dashboards
  20. DVOCmd Command Line Program
  21. Troubleshooting
  22. Datatype Reference
  23. Reporting Views
  24. Metadata Import Syntax
  25. Jasper Reports
  26. Glossary

Data Validation Option User Guide

Data Validation Option User Guide

Sorting and Aggregation Processing

Sorting and Aggregation Processing

The PowerCenter Integration Service or a relational data source can sort and aggregate records. To sort and aggregate records, the relational data source must also process the WHERE clause.
Enable the data source to sort the records when you run tests on tables that have large volumes of data. To minimize disk input and output, sort the records before the PowerCenter Integration Service reads them.
Enable the data source to aggregate data to reduce the number of rows that the PowerCenter Integration Service reads from the database. For example, you use a COUNT test to compare the number of non null records in two Customer_ID columns. If the database processes the sorting and aggregation, the PowerCenter Integration Service does not have to import all customer records to count them.