Table of Contents

Search

  1. Preface
  2. Part 1: Version 10.4.0
  3. Part 2: Version 10.2.2
  4. Part 3: Version 10.2.1
  5. Part 4: Version 10.2
  6. Part 5: Version 10.1.1
  7. Part 6: Version 10.1

Parsing Hierarchical Data on the Spark Engine

Parsing Hierarchical Data on the Spark Engine

Effective in 10.4.0, you can use complex functions to parse up to 5 MB of data midstream in a mapping.
The Spark engine can parse raw string source data using the following complex functions:
  • PARSE_JSON
  • PARSE_XML
The complex functions parse JSON or XML data in the source string and generate struct target data.
For more information, see the "Hierarchical Data Processing" chapter in the
Informatica Data Engineering Integration 10.4.0 User Guide
.
For more information about the complex functions, see the "Functions" chapter in the
Informatica 10.4.0 Developer Transformation Language Reference
.


Updated September 25, 2020