Kafka Connector

Kafka Connector

Configure a mapping to read data from Kafka in real-time

Configure a mapping to read data from Kafka in real-time

You can configure a mapping to read data from a Kafka topic in real-time.
To read data from a Kafka topic in real-time, perform the following tasks:
  1. In the Kafka source advanced properties, configure the
    Connector Mode
    as
    Realtime
    .
  2. Enable message recovery in the
    Advanced Session Properties
    section on the
    Runtime Options
    tab of the mapping task.
    For more information on how to configure the message recovery, see Configure message recovery strategy for a Kafka mapping task.
When you configure a mapping to read data from a Kafka topic in real-time, consider the following rule and guideline:
In the first mapping run, the mapping reads the messages in the Kafka topic based on the value you specify for the
Start Position Offset
source advanced property. In the subsequent mapping runs, the
Recovery Strategy
advanced session property overrides the
Start Position Offset
property and reads the messages from the last checkpoint.

0 COMMENTS

We’d like to hear from you!