Table of Contents

Search

  1. Preface
  2. Introduction to Data Engineering Streaming
  3. Data Engineering Streaming Administration
  4. Sources in a Streaming Mapping
  5. Targets in a Streaming Mapping
  6. Streaming Mappings
  7. Window Transformation
  8. Appendix A: Connections
  9. Appendix B: Monitoring REST API Reference
  10. Appendix C: Sample Files

MapR Streams Header Ports for a Target

MapR Streams Header Ports for a Target

The MapR Streams data object contains default header ports that represent metadata associated with events.
The following table lists the header ports of the MapR Streams data object when you use it as a target:
Header ports
Data type
Description
partitionId
integer
Partition ID of the data. When a stream is divided into partitions, a sequential ID is assigned to each event and is unique to each event within the partition. Use the partition ID to identify the event that you want to consume from a particular partition.
key
binary
Key value associated with an event. You can group events based on the key value and then process the data.
TopicName
string
Name of the stream to which you publish events in the following format:
/<any existing stream>:<topicName>
In case the
<topicName>
is not available in the existing stream, the topic will be automatically created for the data to be published to it.