English
  • Data Engineering Streaming 10.5
  • All Products

Table of Contents

Search

  1. Preface
  2. Introduction to Data Engineering Streaming
  3. Data Engineering Streaming Administration
  4. Sources in a Streaming Mapping
  5. Targets in a Streaming Mapping
  6. Streaming Mappings
  7. Window Transformation
  8. Appendix A: Connections
  9. Appendix B: Monitoring REST API Reference
  10. Appendix C: Sample Files

User Guide

User Guide

Back Next

Complex File Header Port

Complex File Header Port

A complex file data object contains a default header port named FileName. Use the FileName port to write events to different target files. At run time, the Data Integration Service creates a folder for each unique FileName port value with one or more target files in the target location.
The number of target files in each folder might vary based on the timestamp values of the events, the partitions to which the events belong, and the executors that process the events.
For example, after you persist your source data in multiple Kafka topics, you want to write the source data to multiple HDFS files. You can use the FileName port of a complex file data object to write the data to multiple HDFS files.