Table of Contents

Search

  1. Preface
  2. Introduction to Data Engineering Streaming
  3. Data Engineering Streaming Administration
  4. Sources in a Streaming Mapping
  5. Targets in a Streaming Mapping
  6. Streaming Mappings
  7. Transformation in Streaming Mappings
  8. Window Transformation
  9. Appendix A: Connections
  10. Appendix B: Monitoring REST API Reference
  11. Appendix C: Sample Files

Advanced Properties

Advanced Properties

The following table describes the advanced properties for Azure Event Hubs sources:
Property
Description
Operation Type
Specifies the type of data object operation.
This is a read-only property.
Consumer Group
The name of the event hub Consumer Group that you read events from.
Max Rate
The maximum number of events that are consumed in a single batch for each partition.
Shared Access Policy Name
The name of the event hub Shared Access Policy. To read from an event hub, you must have Listen permission.
If you specify a value for this property, it overwrites the value configured in the Azure Event Hubs connection.
Shared Access Policy Primary Key
The primary key of the event hub Shared Access Policy.
If you specify a value for this property, it overwrites the value configured in the Azure Event Hubs connection.
Guaranteed Processing
Ensures that the mapping processes messages that the sources publish and delivers them to the targets at least once. In the event of a failure, there could be potential duplicates but the messages are processed successfully. If the external source or the target is not available, the mapping execution stops to avoid any data loss.
By default, the Guaranteed Processing property is selected.
Start Position Offset
The time from which the Azure Event Hubs data object starts reading messages from an event hub.
You can select one of the following options:
  • CUSTOM. Read messages from a specific time.
  • EARLIEST. Read the earliest messages available on the event hub.
  • LATEST. Read the latest messages from an event hub.
Custom Start Position Enqueue Time
Required if you set the Start Position Offset property to custom. A UTC timezone datetime value in the ISO8601 format from which the Azure Event Hubs data object starts reading events from an event hub.
Specify time in the following format: YYYY-MM-DDThh:mm:ss.sssZ

0 COMMENTS

We’d like to hear from you!