Table of Contents

Search

  1. Preface
  2. Workflow Manager
  3. Workflows and Worklets
  4. Sessions
  5. Session Configuration Object
  6. Tasks
  7. Sources
  8. Targets
  9. Connection Objects
  10. Validation
  11. Scheduling and Running Workflows
  12. Sending Email
  13. Workflow Monitor
  14. Workflow Monitor Details
  15. Session and Workflow Logs
  16. Session Properties Reference
  17. Workflow Properties Reference

Understanding Performance Counters

Understanding Performance Counters

All transformations have some basic counters that indicate the number of input rows, output rows, and error rows.
Source Qualifier, Normalizer, and target transformations have additional counters that indicate the efficiency of data moving into and out of buffers. Use these counters to locate performance bottlenecks.
Some transformations have counters specific to their functionality. For example, each Lookup transformation has a counter that indicates the number of rows stored in the lookup cache.
When you view the performance details file, the first column displays the transformation name as it appears in the mapping, the second column contains the counter name, and the third column holds the resulting number or efficiency percentage. If you use a Joiner transformation, the first column shows two instances of the Joiner transformation:
  • <
    Joiner transformation
    > [M]
    . Displays performance details about the master pipeline of the Joiner transformation.
  • <
    Joiner transformation
    > [D]
    . Displays performance details about the detail pipeline of the Joiner transformation.
When you create multiple partitions, the Integration Service generates one set of counters for each partition. The following performance counters illustrate two partitions for an Expression transformation:
Transformation Name
Counter Name
Counter Value
EXPTRANS [1]
Expression_input rows
8
EXPTRANS [1]
Expression_output rows
8
EXPTRANS [2]
Expression_input rows
16
EXPTRANS [2]
Expression_output rows
16
When you increase the number of partitions, the number of aggregate or rank input rows may be different from the number of output rows from the previous transformation.
The following table describes the Aggegator and Rank Transformation counters/descriptions that may appear in the Session Performance Details area or in the performance details file:
Counters
Description
Aggregator/Rank_
inputrows
Number of rows passed into the transformation.
Aggregator/Rank_
outputrows
Number of rows sent out of the transformation.
Aggregator/Rank_
errorrows
Number of rows in which the Integration Service encountered an error.
Aggregator/Rank_
readfromcache
Number of times the Integration Service read from the index or data cache.
Aggregator/Rank_
writetocache
Number of times the Integration Service wrote to the index or data cache.
Aggregator/Rank_
readfromdisk
Number of times the Integration Service read from the index or data file on the local disk, instead of using cached data.
Aggregator/Rank_
writetodisk
Number of times the Integration Service wrote to the index or data file on the local disk, instead of using cached data.
Aggregator/Rank
_newgroupkey
Number of new groups the Integration Service created.
Aggregator/Rank
_oldgroupkey
Number of times the Integration Service used existing groups.
The following table describes the Lookup Transformation counters/descriptions that may appear in the Session Performance Details area or in the performance details file:
Counters
Description
Lookup
_inputrows
Number of rows passed into the transformation.
Lookup
_outputrows
Number of rows sent out of the transformation.
Lookup
_errorrows
Number of rows in which the Integration Service encountered an error.
Lookup
_rowsinlookupcache
Number of rows stored in the lookup cache.
The following table describes the Master and Detail Joiner Transformation counters/descriptions that may appear in the Session Performance Details area or in the performance details file:
Counters
Description
Joiner
_inputMasterRows
Number of rows the master source passed into the transformation.
Joiner
_inputDetailRows
Number of rows the detail source passed into the transformation.
Joiner
_outputrows
Number of rows sent out of the transformation.
Joiner
_errorrows
Number of rows in which the Integration Service encountered an error.
Joiner_
readfromcache
Number of times the Integration Service read from the index or data cache.
Joiner_
writetocache
Number of times the Integration Service wrote to the index or data cache.
Joiner
_readfromdisk
Number of times the Integration Service read from the index or data files on the local disk, instead of using cached data.
The Integration Service generates this counter when you use sorted input for the Joiner transformation.
Joiner
_writetodisk
Number of times the Integration Service wrote to the index or data files on the local disk, instead of using cached data.
The Integration Service generates this counter when you use sorted input for the Joiner transformation.
Joiner
_readBlockFromDisk
Number of times the Integration Service read from the index or data files on the local disk, instead of using cached data.
The Integration Service generates this counter when you do not use sorted input for the Joiner transformation.
Joiner
_writeBlockToDisk
Number of times the Integration Service wrote to the index or data cache.
The Integration Service generates this counter when you do not use sorted input for the Joiner transformation.
Joiner
_seekToBlockInDisk
Number of times the Integration Service accessed the index or data files on the local disk.
The Integration Service generates this counter when you do not use sorted input for the Joiner transformation.
Joiner
_insertInDetailCache
Number of times the Integration Service wrote to the detail cache. The Integration Service generates this counter if you join data from a single source.
The Integration Service generates this counter when you use sorted input for the Joiner transformation.
Joiner
_duplicaterows
Number of duplicate rows the Integration Service found in the master relation.
Joiner
_duplicaterowsused
Number of times the Integration Service used the duplicate rows in the master relation.
The following table describes All Other Transformation counters/descriptions that may appear in the Session Performance Details area or in the performance details file:
Counters
Description
Transformation
_inputrows
Number of rows passed into the transformation.
Transformation
_outputrows
Number of rows sent out of the transformation.
Transformation
_errorrows
Number of rows in which the Integration Service encountered an error.
If you have multiple source qualifiers and targets, evaluate them as a whole. For source qualifiers and targets, a high value is considered 80-100 percent. Low is considered 0-20 percent.