Release Notes

10.0 HotFix 1

Back Next

Data Quality message queue now supports batching

Until the current release Data Quality message queue requests were processed one at a time. In order to have better performance and resource utilization, these requests can now be batched within the same message queue. This leads to an performance improvement up to factor of 5, especially in scenarios where many single requests to DQ are sent in a very short period of time. E.g. an item change event that was executed on thousands of single objects.

Without batching, a sample data set of 20k item records was taking approximately 25 minutes to complete the execution for a rich set of Data Quality rules.

With batching, the same data set of 20k item records executing the same set of Data Quality rules, completed in approximately 5 minutes.

Results from the test scenario above: