Table of Contents

Search

  1. Preface
  2. Introduction to Data Engineering Streaming
  3. Data Engineering Streaming Administration
  4. Sources in a Streaming Mapping
  5. Targets in a Streaming Mapping
  6. Streaming Mappings
  7. Window Transformation
  8. Appendix A: Connections
  9. Appendix B: Monitoring REST API Reference
  10. Appendix C: Sample Files

Confluent Kafka Broker Properties

Confluent Kafka Broker Properties

The following table describes the Kafka broker properties for the Confluent Kafka connection:
Property
Description
Kafka Broker List
Comma-separated list of Confluent Kafka brokers that maintain the configuration of the Confluent Kafka messaging broker.
To specify a Confluent Kafka broker, use the following format:
<IP address>:<port>
Retry Timeout
Number of seconds after which the Data Integration Service attempts to reconnect to the Confluent Kafka broker to read or write data. If the source or target is not available for the time you specify, the mapping execution stops to avoid any data loss.
Kafka Broker Version
Version of the Confluent Kafka messaging broker.
Additional Connection Properties
Optional. Comma-separated list of connection properties to connect to the Kafka broker.
Schema Registry URL
Location and port of the schema registry provider on which to connect.

Additional Connection Properties

You can use the following syntax for specifying the additional connection properties:
request.timeout.ms=<value>,session.timeout.ms=<value>, fetch.max.wait.ms=<value>,heartbeat.interval.ms=<value>, security.protocol=SASL_PLAINTEXT,sasl.kerberos. service.name=<kerberos name>,sasl.mechanism=GSSAPI, sasl.jaas.config=com.sun.security.auth.module. Krb5Login Modulerequired useKeyTab=true doNotPrompt=true storeKey=true client=true keyTab="<Keytab Location>" principal="<principal>";