Table of Contents

Search

  1. Preface
  2. Using Metadata Manager
  3. Configuring Metadata Manager
  4. Application Resources
  5. Business Glossary Resources
  6. Business Intelligence Resources
  7. Custom Resources
  8. Data Integration Resources
  9. Data Modeling Resources
  10. Database Management Resources
  11. Universal Resources
  12. Managing Resources
  13. Loading and Monitoring Resources
  14. Managing Permissions
  15. Resource Migration
  16. Repository Migration
  17. Appendix A: Metadata Manager Login
  18. Appendix B: Metadata Manager Properties Files
  19. Appendix C: Resource Configuration Files
  20. Appendix D: Glossary

Metadata Manager Administrator Guide

Metadata Manager Administrator Guide

How Metadata Manager Organizes Entities

How Metadata Manager Organizes Entities

The Cloudera Navigator metadata component contains a search-based user interface. However, Metadata Manager displays all objects in the metadata catalog in a hierarchy. Metadata Manager organizes entities in groups based on the entity type.
When you create and load a Cloudera Navigator resource, Metadata Manager creates a parent group in the metadata catalog for each entity type that it extracts from Cloudera Navigator. Metadata Manager places each entity that it extracts in the appropriate group.
The following table describes the entity types that appear in each parent group in the metadata catalog:
Group
Entity Types
ROOT
All HDFS directories and files arranged in a hierarchy. Each HDFS file appears below the directory in which it is located.
HDFS Datasets
All HDFS datasets arranged alphanumerically.
Hive Databases
All Hive databases arranged alphanumerically. Each Hive table appears within the database to which it belongs.
Hive Query Executions
Hive query executions arranged alphanumerically.
Metadata Manager extracts the most recent instance of each Hive query execution. It does not extract older instances.
Hive Query Templates
Hive query templates arranged alphanumerically. Each template part appears below its parent template.
By default, Metadata Manager extracts only Hive query templates that write data to new or existing tables. It does not extract Hive query templates that read data but do not write data.
Oozie Jobs
All Oozie job executions arranged alphanumerically. Because Cloudera Navigator does not generate unique names for Oozie job executions, Metadata Manager appends a time stamp to each Oozie job execution name.
Impala Query Executions
All Impala query executions arranged alphanumerically.
Metadata Manager extracts the most recent instance of each Impala query execution. It does not extract older instances.
Impala Query Templates
All Impala query templates arranged alphanumerically. Each template part appears below its parent template.
By default, Metadata Manager extracts only Impala query templates that write data to new or existing tables. It does not extract Impala query templates that read data but do not write data.
MapReduce Jobs
All MapReduce job executions arranged alphanumerically.
MapReduce Templates
All MapReduce job templates arranged alphanumerically.
Oozie Templates
All Oozie job templates arranged alphanumerically. Because Cloudera Navigator does not generate unique names for Oozie job templates, Metadata Manager appends the Cloudera identity to each Oozie job template name.
Pig Jobs
All Pig job executions arranged alphanumerically. Because multiple Pig job executions can have the same name, Metadata Manager appends a time stamp to each job execution name.
Each Pig table appears below the corresponding Pig job execution.
Pig Templates
All Pig job templates arranged alphanumerically. Because multiple Pig job templates can have the same name, Metadata Manager appends the Cloudera identity to each job template name.
Sqoop Jobs
All Sqoop job executions arranged alphanumerically.
Sqoop Templates
All Sqoop job templates arranged alphanumerically.
YARN Jobs
All YARN job executions arranged alphanumerically.
YARN Templates
All YARN job templates arranged alphanumerically.
If the cluster contains no entities of a certain type, Metadata Manager does not create a parent group for that entity type. For example, if the cluster contains no Pig tables, Pig job templates, or Pig job executions, Metadata Manager does not create the Pig Jobs group or the Pig Templates group.

0 COMMENTS

We’d like to hear from you!