Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Ask INFA.

Table of Contents

Search

  1. Preface
  2. Data Integration performance tuning overview
  3. Optimizing targets
  4. Optimizing sources
  5. Optimizing mappings
  6. Optimizing mapping tasks
  7. Optimizing advanced clusters
  8. Optimizing system performance

Data Integration Performance Tuning

Data Integration Performance Tuning

Optimizing Router transformations

Optimizing Router transformations

When a Router transformation processes many output groups in a mapping in advanced mode, allow data to persist by setting the Spark session property
infaspark.sql.forcePersist=true
in the
mapping
task.
When data persists, the Router transformation doesn't repeat read operations for each output group.

0 COMMENTS

We’d like to hear from you!