Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Edge Data Streaming
  3. Licenses
  4. Using Informatica Administrator
  5. Creating and Managing the Edge Data Streaming Service
  6. Edge Data Streaming Entity Types
  7. Edge Data Streaming Nodes
  8. Data Connections
  9. Working With Data Flows
  10. Managing the Edge Data Streaming Components
  11. Security
  12. High Availability
  13. Disaster Recovery
  14. Monitoring Edge Data Streaming Entities
  15. Appendix A: Troubleshooting
  16. Appendix B: Frequently Asked Questions
  17. Appendix C: Regular Expressions
  18. Appendix D: Command Line Program
  19. Appendix E: Configuring Edge Data Streaming to Work With a ZooKeeper Observer
  20. Appendix F: Glossary

User Guide

User Guide

Kafka Target Service Type

Kafka Target Service Type

Use a Kafka target service to write data to an Apache Kafka publish-subscribe messaging system broker. Kafka runs as a cluster that comprises one or more servers, each of which is called a broker.
When you configure a Kafka target service, specify the topic on which it sends messages and the IP address and port on which the Kafka broker runs.
If you deploy a data flow that contains a Kafta target service, you might have duplication of messages when the EDS Node fails and restarts. The Kafka target service that is running on that EDS Node might receive duplicate messages from the source service when the node comes up later. This duplication of messages occurs because the source service does not receive an acknowledgment from the Kafka target service and resends the messages.
In a high availability setup, you might have duplication of messages when a EDS Node process fails over to one of the backup machines.
For more information about the Apache Kafka messaging system, see http://kafka.apache.org/documentation.html.

0 COMMENTS

We’d like to hear from you!