Table of Contents

Search

  1. Preface
  2. Introduction to Intelligent Streaming
  3. Intelligent Streaming Configuration
  4. Connections
  5. Sources and Targets in a Streaming Mapping
  6. Intelligent Streaming Mappings
  7. Window Transformation
  8. Data Type Reference

Big Data Streaming User Guide

Big Data Streaming User Guide

Processing Hierarchical Data in Streaming Mappings

Processing Hierarchical Data in Streaming Mappings

Data objects in a streaming mapping can process hierarchical data through complex data types. If the source contains hierarchical data, you must enable the read data operation to project columns as complex data types. If you want to project data as complex data types, you must enable the write data operation to project data as complex data types.
The following table shows the format and complex data types that sources in a Streaming mapping support:
Format
Data Type
Amazon Kinesis Streams
JMS
Kafka
MapRStreams
Avro
Flat
Supported
Not supported
Supported
Supported
Avro
Hierarchical
Supported
Not supported
Supported
Supported
JSON
Flat
Supported
Supported
Supported
Supported
JSON
Hierarchical
Supported
Supported
Supported
Supported
XML
Flat
Supported
Supported
Supported
Supported
XML
Hierarchical
Supported
Supported
Supported
Supported
The following table shows the format and complex data types that targets in a Streaming mapping support:
Format
Data Type
Amazon Kinesis Firehose
JMS
Kafka
MapRStreams
Avro
Flat
Not supported
Not supported
Supported
Supported
Avro
Hierarchical
Not supported
Not supported
Supported
Supported
JSON
Flat
Supported
Supported
Supported
Supported
JSON
Hierarchical
Supported
Supported
Supported
Supported
XML
Flat
Not supported
Supported
Supported
Supported
XML
Hierarchical
Not supported
Supported
Supported
Supported
For more information about processing hierarchical data, see the
Informatica Big Data Management User Guide
.