User Guide

10.2.2 Service Pack 1
- 10.5.7
- 10.5.4
- 10.5.2
- 10.5.1
- 10.5
- 10.4.1
- 10.4.0
- 10.2.2
- 10.2.1

Back Next

Complex File Header Port

A complex file data object contains a default header port named FileName. Use the FileName port to write events to different target files. At run time, the Data Integration Service creates a folder for each unique FileName port value with one or more target files in the target location.

The number of target files in each folder might vary based on the timestamp values of the events, the partitions to which the events belong, and the executors that process the events.

For example, after you persist your source data in multiple Kafka topics, you want to write the source data to multiple HDFS files. You can use the FileName port of a complex file data object to write the data to multiple HDFS files.

Complex File Data Objects

Download Guide

Watch

Comments

Communities

Knowledge Base

Success Portal