Table of Contents

Search

  1. Preface
  2. Introduction to Data Validation Option
  3. Repositories
  4. XML Data Source
  5. Tests for XML Data Sources
  6. Connections
  7. Expressions
  8. Table Pairs
  9. Tests for Table Pairs
  10. Single-Table Constraints
  11. Tests for Single-Table Constraints
  12. Examples of Tests from Spreadsheets
  13. SQL Views
  14. Lookup Views
  15. Join Views
  16. Aggregate Views
  17. Business Intelligence and Reporting Tools Reports
  18. Dashboards
  19. DVOCmd Command Line Program
  20. Troubleshooting
  21. Appendix A: Datatype Reference
  22. Appendix B: Reporting Views
  23. Appendix C: Metadata Import Syntax
  24. Appendix D: Jasper Reports
  25. Appendix E: Glossary

Data Validation Option User Guide

Data Validation Option User Guide

Sorting and Aggregation Processing

Sorting and Aggregation Processing

The PowerCenter Integration Service or a relational data source can sort and aggregate records. To sort and aggregate records, the relational data source must also process the WHERE clause.
Enable the data source to sort the records when you run tests on tables that have large volumes of data. To minimize disk input and output, sort the records before the PowerCenter Integration Service reads them.
Enable the data source to aggregate data to reduce the number of rows that the PowerCenter Integration Service reads from the database. For example, you use a COUNT test to compare the number of non null records in two Customer_ID columns. If the database processes the sorting and aggregation, the PowerCenter Integration Service does not have to import all customer records to count them.