Table of Contents

Search

  1. Preface
  2. Introduction to Big Data Streaming
  3. Big Data Streaming Configuration
  4. Sources in a Streaming Mapping
  5. Targets in a Streaming Mapping
  6. Streaming Mappings
  7. Window Transformation
  8. Appendix A: Connections
  9. Appendix B: Data Type Reference
  10. Appendix C: Sample Files

Big Data Streaming User Guide

Big Data Streaming User Guide

Kafka Broker Properties

Kafka Broker Properties

The following table describes the Kafka broker properties for the Kafka connection:
Property
Description
Kafka Broker List
The IP address and port combinations of the Kafka messaging system broker list.
The IP address and port combination has the following format:
<IP Address>:<port>
You can enter multiple comma-separated IP address and port combinations.
ZooKeeper Host Port List
The IP address and port combination of Apache ZooKeeper which maintains the configuration of the Kafka messaging broker.
The IP address and port combination has the following format:
<IP Address>:<port>
You can enter multiple comma-separated IP address and port combinations.
Retry Timeout
Number of seconds the Integration Service attempts to reconnect to the Kafka broker to read data. If the source or target is not available for the time you specify, the mapping execution stops to avoid any data loss.
Kafka Broker Version
The version of the Kafka messaging broker.
You can select one of the following values:
  • 0.8.x.x-0.10.0.x
  • 0.10.1.x-1.0.0
When you click
Test Connection
to verify that you entered the connection properties correctly, the Data Integration Service verifies the connection to ZooKeeper and does not verify the connection to the Kafka broker.