Microsoft Azure Synapse SQL Connector

Back Next

Enabling lookup caching

When you configure a Lookup transformation in a mapping, you can cache the lookup data during the runtime session.

When you select Lookup Caching Enabled
, Data Integration queries the lookup source once and caches the values for use during the session, which can improve performance. You can specify the directory to store the cached lookup.

Lookup Cache Persistent: Use lookup cache persistent to save the lookup cache file to reuse it the next time Data Integration processes a Lookup transformation configured to use the cache.; You can specify the file name prefix to use with persistent lookup cache files in the Cache File Name Prefix
field.; If the lookup table changes occasionally, you can enable the Re-cache from Lookup Source
property to rebuild the lookup cache.
Dynamic Lookup Cache: Use a dynamic lookup cache to keep the lookup cache synchronized with the target. By default, the dynamic lookup cache is disabled and represents static cache.; If the cache is static, the data in the lookup cache does not change as the mapping task runs.; If the task uses the cache multiple times, the task uses the same data. If the cache is dynamic, the task updates the cache based on the actions in the task, so if the task uses the lookup multiple times, downstream transformations can use the updated data.
Pre-build Lookup Cache: Use a pre-build lookup cache to build the lookup cache before the Lookup transformation receives data. Multiple lookup cache files can be built at the same time to improve performance.