Configuring the Messaging Mode in Vibe Data Stream for Machine Data

Configuring the Messaging Mode in Vibe Data Stream for Machine Data

Data Duplication

Data Duplication

If you do not configure load balancing,
VDS
duplicates the data across the data targets.
VDS
delivers all the messages published by the source service to all the data target services so that they have the complete data set for analysis.
The following image shows
VDS
data duplication across the data targets:
The data flow has one source service that publishes data as messages 1 and 2 over the topic logs. Three target services receive both messages and write them to the targets.
VDS
duplicates data as follows:
  1. A source service reads data from the data source and publishes it as two messages over a topic called logs.
  2. An HDFS target service instance runs on three nodes.
  3. VDS
    delivers all the messages to all three target services.
  4. The target services receive both messages and write them to the targets.

0 COMMENTS

We’d like to hear from you!