The examples show how you can add transformations in data flows.
One-to-one Data flow
The following image shows a one-to-one data flow with one transformation each on the source service and on the target service:
The data flow publishes data in the following way:
The File source service publishes data in chunks to the Insert String transformation. The Insert String transformation breaks the chunks into records by using the delimiter on the File source service. The Insert String transformation then transforms each record and publishes the data on a topic.
The target service that listens on the topic, receives the data, and performs Javascript transform on each record.
The File target service then writes the transformed data to the file.
One-to-many Data Flow
The following image shows a one-to-many data flow:
The data flow publishes data in the following way:
The File source service publishes data in chunks to the Insert String transformation. The Insert String transformation breaks the chunks into records by using the delimiter on the File source service. The Insert String transformation then transforms each record and publishes the data on a topic.
Each target service that listens on the topic, receives the data, and performs Javascript transformation and an Insert String transformation on each record.
The File target services then write the transformed data to the files.
Many-to-one Data Flow
The following image shows a many-to-one data flow:
The data flow publishes data in the following way:
The two File source services publish data in chunks to the Insert String transformation. The Insert String transformations breaks the chunks into records by using the delimiter on the File source services. The Insert String transformations then transform each record and publish the data on topics.
The File target service that listens on the topic, receives the data, and performs an Insert String transformation on each record.
The File target service then writes the transformed data to the file.