Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Big Data Management
  3. Mappings in the Hadoop Environment
  4. Mapping Sources in the Hadoop Environment
  5. Mapping Targets in the Hadoop Environment
  6. Mapping Transformations in the Hadoop Environment
  7. Processing Hierarchical Data on the Spark Engine
  8. Configuring Transformations to Process Hierarchical Data
  9. Processing Unstructured and Semi-structured Data with an Intelligent Structure Model
  10. Stateful Computing on the Spark Engine
  11. Monitoring Mappings in the Hadoop Environment
  12. Mappings in the Native Environment
  13. Profiles
  14. Native Environment Optimization
  15. Cluster Workflows
  16. Connections
  17. Data Type Reference
  18. Function Reference
  19. Parameter Reference

Rules and Guidelines for Intelligent Structure Models

Rules and Guidelines for
Intelligent Structure Model
s

Consider the following rules and guidelines when you work with
Intelligent structure model
:
  • If the
    Intelligent structure model
    does not match the input file, or only partially matches the input file, there might be a large amount of unidentified data and data loss. It is important therefore to choose a representative file to create the model.
  • When you create an
    Intelligent structure model
    in
    Intelligent Structure Discovery
    , ensure that the names for output groups follow the Developer tool naming conventions.
    • To ensure compatibility, an element name must contain only English letters (A- Z, a-z), numerals (0-9), and underscores.
    • Do not use reserved logical terms such as And, Or, or other reserved names.
    • Do not start element names with a number.
    • Do not use duplicate names for different elements.
  • Ensure that the
    Intelligent structure model
    is valid before you add it to the Column Projection properties of the data object properties.
  • You can only use a Read transformation with an
    Intelligent structure model
    in a mapping. Do not create or use a Write transformation with an
    Intelligent structure model
    , as the mapping will fail.
  • If the
    Intelligent structure model
    version is incompatible with the Big Data Management version, import the model in a compatible model version from Data Integration.
  • A data object with an
    Intelligent structure model
    parse PDF forms, Microsoft Word tables, and XML files whose size is less than the supported Hadoop split size of 256 M.
  • An
    Intelligent structure model
    can parse the data within PDF form fields but not data outside the fields.
  • An
    Intelligent structure model
    can parse data within Microsoft Word tables. Other data is unidentified.


Updated October 23, 2019