Table of Contents

Search

  1. Preface
  2. Introduction to Data Engineering Streaming
  3. Data Engineering Streaming Administration
  4. Sources in a Streaming Mapping
  5. Targets in a Streaming Mapping
  6. Streaming Mappings
  7. Transformation in Streaming Mappings
  8. Window Transformation
  9. Appendix A: Connections
  10. Appendix B: Monitoring REST API Reference
  11. Appendix C: Sample Files

MapR Streams Header Ports for a Source

MapR Streams Header Ports for a Source

The MapR Streams data object contains default header ports that represent metadata associated with events.
The following table lists the header ports of the MapR Streams data object when you use it as a source:
Header ports
Data type
Description
partitionId
integer
Partition ID of the data. When a MapR stream is divided into partitions, a sequential ID is assigned to each event and is unique to each event within the partition. Use the partition ID to identify the event that you want to consume from a particular partition.
key
binary
Key value associated with an event. You can group events based on the key value and then process the data.
TopicName
string
Name of the stream from which you receive events.
timestamp
date/time
Time at which an event is generated. You can accumulate streamed data into data groups and then process the data groups based on the timestamp values.

0 COMMENTS

We’d like to hear from you!