Table of Contents

  1. Preface
  2. Introduction to Informatica Edge Data Streaming
  3. Licenses
  4. Using Informatica Administrator
  5. Creating and Managing the Edge Data Streaming Service
  6. Edge Data Streaming Entity Types
  7. Edge Data Streaming Nodes
  8. Data Connections
  9. Working With Data Flows
  10. Managing the Edge Data Streaming Components
  11. Security
  12. High Availability
  13. Disaster Recovery
  14. Monitoring Edge Data Streaming Entities
  15. Troubleshooting
  16. Frequently Asked Questions
  17. Regular Expressions
  18. Command Line Program
  19. Configuring Edge Data Streaming to Work With a ZooKeeper Observer
  20. Glossary

User Guide

User Guide

Examples of Transformations in Data Flows

The examples show how you can add transformations in data flows.
One-to-one Data flow
The following image shows a one-to-one data flow with one transformation each on the source service and on the target service:
The data flow publishes data in the following way:
  1. The File source service publishes data in chunks to the Insert String transformation. The Insert String transformation breaks the chunks into records by using the delimiter on the File source service. The Insert String transformation then transforms each record and publishes the data on a topic.
  2. The target service that listens on the topic, receives the data, and performs Javascript transform on each record.
  3. The File target service then writes the transformed data to the file.
One-to-many Data Flow
The following image shows a one-to-many data flow:
The data flow publishes data in the following way:
  1. The File source service publishes data in chunks to the Insert String transformation. The Insert String transformation breaks the chunks into records by using the delimiter on the File source service. The Insert String transformation then transforms each record and publishes the data on a topic.
  2. Each target service that listens on the topic, receives the data, and performs Javascript transformation and an Insert String transformation on each record.
  3. The File target services then write the transformed data to the files.
Many-to-one Data Flow
The following image shows a many-to-one data flow:
The data flow publishes data in the following way:
  1. The two File source services publish data in chunks to the Insert String transformation. The Insert String transformations breaks the chunks into records by using the delimiter on the File source services. The Insert String transformations then transform each record and publish the data on topics.
  2. The File target service that listens on the topic, receives the data, and performs an Insert String transformation on each record.
  3. The File target service then writes the transformed data to the file.


Updated March 19, 2019


Explore Informatica Network