Table of Contents

Search

  1. Preface
  2. Introduction to Big Data Streaming
  3. Big Data Streaming Administration
  4. Sources in a Streaming Mapping
  5. Targets in a Streaming Mapping
  6. Streaming Mappings
  7. Window Transformation
  8. Appendix A: Connections
  9. Appendix B: Sample Files

Advanced Properties

Advanced Properties

The Developer tool displays the advanced properties for Kafka targets in the Input transformation in the
Write
view.
The following table describes the advanced properties that you configure for Kafka targets:
Property
Description
Operation Type
Specifies the type of data object operation.
This is a read-only property.
Metadata Fetch Timeout in milliseconds
The time after which the metadata is not fetched.
Batch Flush Time in milliseconds
The interval after which the data is published to the target.
Batch Flush Size in bytes
The batch size of the events after which the data is written to the target.
Producer Configuration Properties
The configuration properties for the producer. If the Kafka data object is writing data to a Kafka cluster that is configured for Kerberos authentication, include the following property:
security.protocol=SASL_PLAINTEXT,sasl.kerberos.service.name=kafka,sasl.mechanism=GSSAPI
For more information about Kafka broker properties, see http://kafka.apache.org/082/documentation.html.

0 COMMENTS

We’d like to hear from you!