Table of Contents

Search

  1. Preface
  2. Introduction to Data Engineering Streaming
  3. Data Engineering Streaming Administration
  4. Sources in a Streaming Mapping
  5. Targets in a Streaming Mapping
  6. Streaming Mappings
  7. Window Transformation
  8. Appendix A: Connections
  9. Appendix B: Monitoring REST API Reference
  10. Appendix C: Sample Files

Processing Hierarchical Data in Streaming Mappings

Processing Hierarchical Data in Streaming Mappings

Data objects in a streaming mapping can process hierarchical data through complex data types. If you want to project data as complex data types, you must enable the write data operation to project data as complex data types.
The following table shows the format and complex data types that targets in a Streaming mapping support:
Format
Schema Type
Amazon Kinesis Firehose
Amazon S3
Azure Data Lake Store
Azure Event Hub
Complex File
JMS
Kafka
MapR Streams
Avro
Flat
Not supported
Supported
Supported
Supported
Supported
Not supported
Supported
Supported
Avro
Hierarchical
Not supported
Supported
Supported
Supported
Supported
Not supported
Supported
Supported
Binary
Binary
Supported
Not Supported
Supported
Supported
Supported
Supported
Supported
Supported
Flat
Flat
Not Supported
Supported
Not Supported
Supported
Not supported
Supported
Supported
Not Supported
JSON
Flat
Supported
Supported
Supported
Supported
Supported
Supported
Supported
Supported
JSON
Hierarchical
Supported
Supported
Supported
Supported
Supported
Supported
Supported
Supported
XML
Flat
Not supported
Not Supported
Supported
Supported
Supported
Supported
Supported
Supported
XML
Hierarchical
Not supported
Not Supported
Supported
Supported
Supported
Supported
Supported
Supported
For more information about processing hierarchical data, see the
Data Engineering Integration User Guide
.

0 COMMENTS

We’d like to hear from you!