EDS uses a data connection to transport data from the source service to the target service. Use the Administrator tool to design the flow of data from the data source to the data target, deploy the data flow, and monitor the data flow.
The following image shows a simple
EDS data flow:
The data flow consists of the following components:
You can read data from the following sources:
Call detail records
OPC DA sources
Ultra Messaging applications
EDS Node runs on host machines on which you want to run a source service or a target service. A
EDS Node can contain the following entities:
Source service. A source service collects data from a data source and publishes the data. You can run a source service on a machine that either hosts the data source or can access it.
Target service. A target service receives data from one or more source services and writes the data to a data target. You can run the target service on a machine that either hosts the data target or can access it.
Aggregator. An aggregator collects data from source services or other aggregators and publishes the data to target services or other aggregators.
Transformation. A process that transforms the data that a source service or aggregator publish or the data that a target service or aggregator receive, or both. A transformation runs on the EDS Node that contains the source service, the target service, or the aggregator.
You can write data to the following targets:
Hadoop Distributed File System (HDFS) cluster
Amazon Kinesis streams
Apache Kafka publish-subscribe messaging system broker
Azure Event Hubs
Ultra Messaging application
EDS Nodes use a data connection to transport data from a source service to a target service. When you design a data flow, you can choose one of the following data connections:
Ultra Messaging. If you choose the Ultra Messaging data connection,
EDS uses the Ultra Messaging or the publish/subscribe model to transport data.
WebSocket. If you choose the WebSocket data connection,
EDS uses the WebSocket protocol, which provides bi-directional communication over a single TCP connection.