Communities
A collaborative platform to connect and grow with like-minded Informaticans across the globe
Product Communities
Connect and collaborate with Informatica experts and champions
Discussions
Have a question? Start a Discussion and get immediate answers you are looking for
User Groups
Customer-organized groups that meet online and in-person. Join today to network, share ideas, and get tips on how to get the most out of Informatica
Get Started
Community Guidelines
Knowledge Center
Troubleshooting documents, product guides, how to videos, best practices, and more
Knowledge Base
One-stop self-service portal for solutions, FAQs, Whitepapers, How Tos, Videos, and more
Support TV
Video channel for step-by-step instructions to use our products, best practices, troubleshooting tips, and much more
Documentation
Information library of the latest product documents
Velocity (Best Practices)
Best practices and use cases from the Implementation team
Learn
Rich resources to help you leverage full capabilities of our products
Trainings
Role-based training programs for the best ROI
Certifications
Get certified on Informatica products. Free, Foundation, or Professional
Product Learning Paths
Free and unlimited modules based on your expertise level and journey
Resources
Library of content to help you leverage the best of Informatica products
Tech Tuesdays Webinars
Most popular webinars on product architecture, best practices, and more
Product Availability Matrix
Product Availability Matrix statements of Informatica products
SupportFlash
Monthly support newsletter
Support Documents
Informatica Support Guide and Statements, Quick Start Guides, and Cloud Product Description Schedule
Product Lifecycle
End of Life statements of Informatica products
Ideas
Events
Change Request Tracking
Marketplace
English
  • Operational Insights
  • All Products

Table of Contents

Search

  1. Preface
  2. Part 1: Introducing Operational Insights
  3. Part 2: Monitoring Informatica Intelligent Cloud Services
  4. Part 3: Monitoring on-premises applications

Operational Insights

Operational Insights

Back Next

Understanding collectors

Understanding collectors

Collectors are components that run within the Secure Agent that communicates with an Informatica domain. You do not need to configure a collector to collect data from a specific asset. The Secure Agent is aware of all assets within the domain, and each enabled collector collects operational data and metadata from the relevant assets.
The collectors can collect data from all Informatica release 10.x domains. If needed, you can disable any collector except for the Domain Configuration Collector. You can also change the default collection schedule for each collector.
The collectors begin collecting and uploading data to Informatica Intelligent Cloud Services after you click
Save
 as the final step in the domain registration process. Data is uploaded to
Operational Insights
 at the time it is collected.
The following collectors are deployed with the Secure Agent:
Collector
Description
Default Collection Frequency
Metadata Collected
Domain Configuration Collector
Collects and uploads configuration metadata for the domain and all domain assets, including nodes and services.*
Every 24 hours
  • Domain details: Domain name, list of nodes in the domain, details for grids within the domain.
  • Node details: Name, HTTP port, logs directory, maximum processes, list of services running.
  • System configuration for each node: Operating system details, number of CPU cores and CPU speed, physical memory details.
Domain Health Statistics Collector
Collects and uploads availability statistics for domain assets, including nodes and application services.*
Every 5 minutes
  • Availability statistics: Domains, nodes, services, and grids.
Domain Resource Usage Statistics Collector
Collects and uploads CPU and memory consumption statistics for all nodes within the domain.
The collector collects the statistics from the Model repository managed by the monitoring Model Repository Service specified in the Monitoring Configuration for the domain.
Every 1 hour
  • CPU utilization: Informatica processes and all processes running on each node.
  • Memory utilization: Informatica processes and all processes running on each node.
Data Engineering Integration Collector
Collects and uploads statistics on Data Engineering Integration jobs run on Hadoop.
You must specify the cluster configuration that contains the configuration information for each Hadoop cluster you want to collect statistics from.
Every 1 hour
  • Hadoop cluster configuration: Number of clusters and nodes by Hadoop distribution.
  • Hadoop cluster resource usage: CPU and memory utilization for Informatica processes and all processes running on each cluster node.
  • Job execution statistics: Type of job, how many rows inserted/rejected, how many mappings failed/succeeded, volume of data processed, start and end time, Data Integration Service that submitted the job.
  • Runtime metrics: Number and type of unique mappings and workflows that ran on each cluster or on all clusters.
Data Quality Collector
Collects and uploads statistics on Data Quality jobs run on Hadoop.
Every 1 hour
  • Job execution statistics: Type of job, how many rows inserted/rejected, how many mappings failed/succeeded, volume of data processed, start and end time, Data Integration Service that submitted the job.
  • Runtime metrics: Number and type of unique mappings and workflows that ran on each cluster or on all clusters.
PowerCenter Repository Collector
Collects and uploads runtime workflow and session metrics from PowerCenter repositories within the domain.
You must provide the JDBC connection details for the repository database for each PowerCenter repository you want to collect statistics from.
Every 1 hour
  • Workflow details: Workflow name, start and end time, status (succeeded, failed, etc.), PowerCenter Integration Service than submitted the workflow.
  • Session tasks: Task ID and type, start and end time, rows read, rows written, node the task ran on.
  • Repository folder details: Folder ID and name.
*
If the Informatica domain that you registered to monitor using Operational Insights has multiple gateway nodes and the domain fails over from the master gateway node to another, the Domain Configuration Collector and the Domain Health Statistics Collector internally switch the collection to other gateway nodes in the domain and continue to work seamlessly.
0 COMMENTS
We’d like to hear from you!