Table of Contents

Search

  1. Preface
  2. Data Integration performance tuning overview
  3. Optimizing targets
  4. Optimizing sources
  5. Optimizing mappings
  6. Optimizing mapping tasks
  7. Optimizing advanced clusters
  8. Optimizing system performance

Data Integration Performance Tuning

Data Integration Performance Tuning

Identifying Source Bottlenecks

Identifying Source Bottlenecks

You can read the thread statistics in the session log to determine if the source is the bottleneck. When a mapping spends more time on the reader thread than the transformation or writer threads, you have a source bottleneck.
If the mapping reads from a cloud database or data warehouse source, use the following methods to identify source bottlenecks:
  • Use a Filter transformation.
  • Use a read test mapping.
  • Use a database query.
If the mapping reads from a flat file source, you probably don't have a source bottleneck.

0 COMMENTS

We’d like to hear from you!