Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Big Data Management
  3. Mappings
  4. Sources
  5. Targets
  6. Transformations
  7. Data Preview
  8. Cluster Workflows
  9. Profiles
  10. Monitoring
  11. Hierarchical Data Processing
  12. Hierarchical Data Processing Configuration
  13. Hierarchical Data Processing with Schema Changes
  14. Intelligent Structure Models
  15. Stateful Computing
  16. Appendix A: Connections
  17. Appendix B: Data Type Reference
  18. Appendix C: Function Reference

Dynamic Complex Ports

Dynamic Complex Ports

A dynamic complex port receives one or more elements of a complex port or a hierarchical data column based on input rules. You can use dynamic complex ports such as dynamic array, dynamic map, and dynamic struct in some transformations on the Spark engine.
The following image shows the ports that you can use in a mapping to process hierarchical data with schema changes:
  1. Complex port
  2. Dynamic port
  3. Dynamic complex port
Complex port
A port of a complex data type in a transformation that can pass or process hierarchical data. Array, map, and struct ports are complex ports. Based on the complex data type, you specify the complex port properties as the type configuration.
Dynamic port
A port in a transformation that can receive one or more columns from an upstream transformation. Dynamic ports can receive new or changed columns as generated ports based on the metadata that passes through the mapping. The input rules for a dynamic port determine the generated ports.
Dynamic complex port
A port in a transformation that can pass or process hierarchical data with new or changed elements based on the schema changes of the hierarchical data. The input rules for a dynamic complex port determine the data type of the hierarchical data elements or the schema of the hierarchical data.


Updated July 10, 2020