Table of Contents

Search

  1. Preface
  2. Data Integration performance tuning overview
  3. Optimizing targets
  4. Optimizing sources
  5. Optimizing mappings
  6. Optimizing mapping tasks
  7. Optimizing advanced clusters
  8. Optimizing system performance

Data Integration Performance Tuning

Data Integration Performance Tuning

Caching lookup tables

Caching lookup tables

If a mapping contains Lookup transformations, you might want to enable lookup caching.
When you enable caching,
Data Integration
caches the lookup table and queries the lookup cache during the task run. When this option isn't enabled,
Data Integration
queries the lookup table on a row-by-row basis.
The result of the lookup query and processing is the same, whether or not you cache the lookup table. However, using a lookup cache can increase mapping performance for smaller lookup tables. In general, you want to cache lookup tables that need less than 300 MB.
If you enable lookup caching, perform the following tasks to increase performance:
  • Use the appropriate cache type.
  • Enable concurrent caches.
  • Optimize lookup condition matching.
  • Reduce the number of cached rows.
  • Override the ORDER BY statement.
  • Use a machine with more memory.

0 COMMENTS

We’d like to hear from you!