PowerExchange for Kafka User Guide for PowerCenter

PowerExchange for Kafka User Guide for PowerCenter

Configure Kafka Source Session Properties

Configure Kafka Source Session Properties

You can configure the session properties for a Kafka source on the
Mapping
tab. Define the properties for the source instance in the session.
The following table describes the session properties that you can configure for a Kafka source session:
Property
Description
Start position offset
The time from which the Kafka source starts reading Kafka messages from a Kafka topic.
You can select one of the following options:
  • Custom. Read messages from a specific time.
  • Earliest. Read the earliest messages available on the Kafka topic.
  • Latest. Read messages received by the Kafka topic after the mapping has been deployed.
Custom Start Position Timestamp
The time in GMT from which the Kafka source starts reading Kafka messages from a Kafka topic.
Specify a time in the following format:
dd-MM-yyyy HH:mm:ss.SSS
The milliseconds are optional.
Consumer Configuration Properties
The configuration properties for the consumer.
If you read data from a Kafka cluster that is configured for Kerberos authentication, specify the following property to override the
Additional Connection Properties
specified in the Kafka connection:
security.protocol=SASL_PLAINTEXT,sasl.kerberos.service.name=kafka,sasl.mechanism=GSSAPI
Recover from last state
If you select this option, the PowerCenter Integration Service recovers a stopped, aborted, or terminated session from the last checkpoint.
Default is selected.
Topic Pattern
Specify a regular expression pattern for the topic name that you want to read from. Use the regular expression syntax guidelines to specify the pattern.
For more information about how to use topic patterns to read data from a Kafka source, see the Knowledge Base article 565201.
Tracing Level
Amount of detail displayed in the session log for the transformation. You can choose Normal, Verbose Initialization, or Verbose Data.
Default is Normal.

0 COMMENTS

We’d like to hear from you!