Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Big Data Management
  3. Mappings in the Hadoop Environment
  4. Mapping Sources in the Hadoop Environment
  5. Mapping Targets in the Hadoop Environment
  6. Mapping Transformations in the Hadoop Environment
  7. Processing Hierarchical Data on the Spark Engine
  8. Configuring Transformations to Process Hierarchical Data
  9. Processing Unstructured and Semi-structured Data with an Intelligent Structure Model
  10. Stateful Computing on the Spark Engine
  11. Monitoring Mappings in the Hadoop Environment
  12. Mappings in the Native Environment
  13. Profiles
  14. Native Environment Optimization
  15. Cluster Workflows
  16. Connections
  17. Data Type Reference
  18. Function Reference
  19. Parameter Reference

Big Data Management User Guide

Big Data Management User Guide

Flatten Hierarchical Data

Flatten Hierarchical Data

You can flatten elements of hierarchical data into relational data. Use the
Flatten Complex Port
wizard in the Developer tool to perform the conversion.
The wizard converts hierarchical data to relational data. When you have hierarchical data with nested data type, you can select specific elements or all elements of complex data type to flatten.
Based on the data type of the complex port, the wizard performs the following tasks:
struct
  • Adds an Expression transformation with flattened output ports. The expression for the output ports uses the dot operator to extract elements in the struct.
  • Adds a final Expression transformation that contains a dynamic port with all ports from the upstream transformation including the flattened struct ports.
array
Adds a Normalizer transformation with flattened output ports. The wizard flattens the array field in the Normalizer view.
Adds a final Expression transformation that contains a dynamic port with all ports from the upstream transformation including the flattened array ports.
nested data type
Adds one or more Expression and Normalizer transformations with flattened output ports. If you select a child element of a nested complex port, the wizard flattens both the parent and child elements.
Adds a final Expression transformation that contains a dynamic port with all ports from the upstream transformation including the flattened ports.

0 COMMENTS

We’d like to hear from you!