Effective in version 9.6.1 HotFix 3, you can enable incremental loading and create search queries to decrease the amount of time it takes for Metadata Manager to load Cloudera Navigator resources.
You can configure the following properties when you create or edit a Cloudera Navigator resource:
Enable incremental load
Enables incremental loading for Cloudera Navigator resources after the first successful resource load. When you enable this option, Metadata Manager loads recent changes to the metadata instead of loading complete metadata.
During an incremental load, Metadata Manager extracts only the following entities:
HDFS entities that were created or changed after the previous resource load
All Hive tables, views, and partitions
Operation executions that were created after the previous resource load
All templates related to the new operation executions
Query that limits the HDFS entities that Metadata Manager extracts. By default, Metadata Manager does not extract HDFS entities from certain directories that contain only canary files, log files, history files, or deleted files. You can update the default search query to prevent Metadata Manager from extracting other HDFS entities. The query that you enter must use valid Cloudera Navigator search syntax.
For more information about Cloudera Navigator resources, see the