Table of Contents

Search

  1. Preface
  2. Understanding Pipeline Partitioning
  3. Partition Points
  4. Partition Types
  5. Pushdown Optimization
  6. Pushdown Optimization and Transformations
  7. Real-time Processing
  8. Commit Points
  9. Row Error Logging
  10. Workflow Recovery
  11. Stopping and Aborting
  12. Concurrent Workflows
  13. Grid Processing
  14. Load Balancer
  15. Workflow Variables
  16. Parameters and Variables in Sessions
  17. Parameter Files
  18. FastExport
  19. External Loading
  20. FTP
  21. Session Caches
  22. Incremental Aggregation
  23. Session Log Interface
  24. Understanding Buffer Memory
  25. High Precision Data

Advanced Workflow Guide

Advanced Workflow Guide

Understanding the Error Log File

Understanding the Error Log File

You can create an error log file to collect all errors that occur in a session. This error log file is a column delimited line sequential file. By specifying a unique error log file name, you can create a separate log file for each session in a workflow. When you want to analyze the row errors for one session, use an error log file.
In an error log file, double pipes “||” delimit error logging columns. By default, pipe “|” delimits row data. You can change this row data delimiter by setting the Data Column Delimiter error log option.
Error log files have the following structure:
[Session Header] [Column Header] [Column Data]
Session header contains session run information similar to the information stored in the PMERR_SESS table. Column header contains data column names. Column data contains row data and error message information.
The following table describes the columns in an error log file:
Log File Column Header
Description
Transformation
Name of the transformation used by a mapping where an error occurred.
Transformation Mapplet Name
Name of the mapplet that contains the transformation. n/a appears when this information is not available.
Transformation Group
Name of the input or output group where an error occurred. Defaults to either “input” or “output” if the transformation does not have a group.
Partition Index
Specifies the partition number of the transformation partition where an error occurred.
Transformation Row ID
Specifies the row ID for the error row.
Error Sequence
Counter for the number of errors per row in each transformation group. If a session has multiple partitions, the Integration Service maintains this counter for each partition.
For example, if a transformation generates three errors in partition 1 and two errors in partition 2, ERROR_SEQ_NUM generates the values 1, 2, and 3 for partition 1, and values 1 and 2 for partition 2.
Error Timestamp
Timestamp of the Integration Service when the error occurred.
Error UTC Time
Coordinated Universal Time, called Greenwich Mean Time, when the error occurred.
Error Code
Error code that corresponds to the error message.
Error Message
Error message.
Error Type
Type of error that occurred. The Integration Service uses the following values:
1 - Reader error
2 - Writer error
3 - Transformation error
Transformation Data
Delimited string containing all column data, including the column indicator. Column indicators are:
D - valid
O - overflow
N - null
T - truncated
B - binary
U - data unavailable
The fixed delimiter between column data and column indicator is a colon ( : ). The delimiter between the columns is a pipe ( | ). You can override the column delimiter in the error handling settings.
The Integration Service converts all column data to text string in the error file. For binary data, the Integration Service uses only the column indicator.
Source Name
Name of the source qualifier. N/A appears when a row error occurs downstream of an active source that is not a source qualifier or a non pass-through partition point with more than one partition.
Source Row ID
Value that the source qualifier assigns to each row it reads. If the Integration Service cannot identify the row, the value is -1.
Source Row Type
Row indicator that tells whether the row was marked for insert, update, delete, or reject.
0 - Insert
1 - Update
2 - Delete
3 - Reject
Source Data
Delimited string containing all column data, including the column indicator. Column indicators are:
D - valid
O - overflow
N - null
T - truncated
B - binary
U - data unavailable
The fixed delimiter between column data and column indicator is a colon ( : ). The delimiter between the columns is a pipe ( | ). You can override the column delimiter in the error handling settings.
The Integration Service converts all column data to text string in the error table or error file. For binary data, the Integration Service uses only the column indicator.


Updated November 14, 2019