Google BigQuery Connectors

Back Next

Enabling lookup caching

When you configure a Lookup transformation in a mapping, you can cache the lookup data during the runtime session.

When you select Lookup Caching Enabled
, Data Integration queries the lookup source once and caches the values for use during the session, which can improve performance. You can specify the directory to store the cached lookup.

Lookup Cache Persistent: Use lookup cache persistent to save the lookup cache file to reuse it the next time Data Integration processes a Lookup transformation configured to use the cache.; You can specify the file name prefix to use with persistent lookup cache files in the Cache File Name Prefix
field.; If the lookup table changes occasionally, you can enable the Re-cache from Lookup Source
property to rebuild the lookup cache.; When you enable lookup cache persistent, the mappings don't show messages related to staging optimization.
Dynamic Lookup Cache: Use a dynamic lookup cache to keep the lookup cache synchronized with the target. By default, the dynamic lookup cache is disabled and represents static cache.; If the cache is static, the data in the lookup cache does not change as the mapping task runs.; If the task uses the cache multiple times, the task uses the same data. If the cache is dynamic, the task updates the cache based on the actions in the task, so if the task uses the lookup multiple times, downstream transformations can use the updated data.