Data Validation Option Best Practices

Data Validation Option Best Practices

Count Tests

Count Tests

Count tests are common tests performed on data. They count all non null values in a column and provide a simple check to see if the expected number of values are present. In the following table, five count tests were performed on a table pair with 50 data columns. The performance is consistent, averaging about 57,000 rows per second across all tests, as shown in the following table:
Joined
Rows
Columns
Test Types
Average Time
Rows/Sec
No
1,000,000
50
5 Count
16 seconds
63,830
No
2,000,000
50
5 Count
36 seconds
56,604
No
5,000,000
50
5 Count
1 minutes 35 seconds
52,817
No
10,000,000
50
5 Count
3 minutes 1 second
55,351

0 COMMENTS

We’d like to hear from you!