Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Ask INFA.

Table of Contents

Search

  1. Preface
  2. Data Integration performance tuning overview
  3. Optimizing targets
  4. Optimizing sources
  5. Optimizing mappings
  6. Optimizing mapping tasks
  7. Optimizing advanced clusters
  8. Optimizing system performance

Data Integration Performance Tuning

Data Integration Performance Tuning

Caches

Caches

Data Integration
uses the index and data caches for XML targets and Aggregator, Rank, Lookup, and Joiner transformations.
Data Integration
stores transformed data in the data cache before returning it to the pipeline.
Data Integration
stores group information in the index cache. Also,
Data Integration
uses a cache to store data for Sorter transformations.
To configure the amount of cache memory, specify the cache size. If the allocated cache isn't large enough to store the data,
Data Integration
stores the data in a temporary disk file, a cache file, as it processes the task data. Performance slows each time
Data Integration
pages to a temporary file.
Perform the following tasks to optimize caches:
  • Limit the number of connected input/output and output only fields.
  • Increase the cache sizes.

0 COMMENTS

We’d like to hear from you!
Koki Watanabe - November 14, 2023

When Auto is selected for Joiner Data Cache Size, are Joiner cache files not created in the Cache Directory up to a certain threshold? 
I would like to know when multiple cache files are created.

Informatica Documentation Team - November 14, 2023

Hi Koki Watanabe,

Thanks for reaching out! We'll forward your question to our development and QA teams and get back to you shortly.


Informatica Documentation Team - November 15, 2023

Hi Koki Watanabe,

By default, cache files for the Joiner transformation are created in the directory specified by the system variable $PMCacheDir, which is entered in the Secure Agent $PMCacheDir property for the Data Integration Server.

If the “Data Cache Size” property for the Joiner transformation is set to “Auto,” then the default cache size is 2,000,000 bytes. If the data volume processed by the Joiner transformation exceeds the default or configured cache size, then multiple cache files will be created.

Most of this is explained in the “Advanced properties” topic for the Joiner transformation and the “Transformation caches” topic in the Transformations guide. However, the default cache size isn’t listed there. We’ll update the documentation to include the default cache size for the next major release.