PowerExchange for Kafka User Guide for PowerCenter

PowerExchange for Kafka User Guide for PowerCenter

Configure Message Recovery Strategy for a Kafka Session

Configure Message Recovery Strategy for a Kafka Session

When you configure message recovery for a real-time session, the PowerCenter Integration Service can recover unprocessed messages from a failed session. When you enable message recovery for a real-time session, the PowerCenter Integration Service stores source messages or message IDs in a recovery file, recovery table, recovery queue, or recovery topic. If the session fails, run the session in recovery mode to recover the messages that the PowerCenter Integration Service did not process. For sessions with Kafka topics, the PowerCenter Integration Service connects to the recovery topic as a durable subscriber so messages persist even if the session ends.
When you configure a session for recovery, you can recover the session when you recover a workflow, or you can recover the session without running the rest of the workflow.
When you configure a session, you can configure the
Recovery Strategy
property on the
Properties
page of the Session task.
You can select one of the following recovery strategies:
  • Resume from the last checkpoint.
    The PowerCenter Integration Service saves the session state of operation and maintains target recovery tables. If the session aborts, stops, or terminates, the PowerCenter Integration Service uses the saved recovery information to resume the session from the point of interruption. You cannot configure a session with a resume strategy if it uses mapping variables.
  • Restart task.
    The PowerCenter Integration Service runs the session again when it recovers the workflow. When you recover with restart task, you might need to remove the partially loaded data in the target or design a mapping to skip the duplicate rows.
  • Fail task and continue workflow.
    When the PowerCenter Integration Service recovers a workflow, it does not recover the session. The session status becomes failed, and the PowerCenter Integration Service continues running the workflow.

Steps to Enable Message Recovery

Complete the following steps to enable message recovery for sessions:
  1. In the session properties, select Resume from Last Checkpoint as the recoverystrategy.
  2. Specify a recovery cache directory in the session properties at each partition point.
The PowerCenter Integration Service stores messages in the location indicated by the recovery cache directory. The default value recovery cache directory is $PMCacheDir.

0 COMMENTS

We’d like to hear from you!