Table of Contents

Search

  1. Preface
  2. Components
  3. API collections
  4. Business services
  5. File listeners
  6. Fixed-width file formats
  7. Hierarchical schemas
  8. Intelligent structure models
  9. Refining intelligent structure models
  10. Mapplets
  11. Saved queries
  12. Shared sequences
  13. User-defined functions

Components

Components

Creating an intelligent structure model

Creating an
intelligent structure model

Create an
intelligent structure model
based on input that represents the data that you expect the model to parse at run time.
  1. Click
    New
    Components
    Intelligent Structure Model
    , and then click
    Create
    .
  2. On the
    Intelligent Structure Model
    page, enter a name for the
    intelligent structure model
    .
    The name can contain alphanumeric characters and underscores.
  3. Navigate to the project and folder where you want to save the model, or use the default location.
    You can change the name or location after you save the
    intelligent structure model
    using the
    Explore
    page.
  4. Based on the type of input that you create the model for, perform one of the following actions:
    • Select a sample file or an Avro schema file and click
      Discover Structure
      .
    • Select an XSD schema file, verify that the schema root is selected, and click
      Discover Structure
      . If you intend to use the model in a structure Parser transformation, you can click
      Upload XML Sample
      and select an XML sample file to attach to the model. The output groups in the sample file appear on the
      Relational Output
      tab.
    • Select a Cobol copybook. If required, modify the values of
      File organization
      and
      Code Page
      to use at run time. Click
      Discover Structure
      .
    Intelligent Structure Discovery
    deciphers the data in the input and discovers the patterns expressed in the data. The following image shows an example of discovered structure on the
    Visual Model
    tab:
    The Visual Model tab shows an example of a discovered structure with a hierarchy of nodes. In the top row, table is the parent of element. In the second row, element is the parent of IP, value, token, element, element, statusCode, and number. In the third row, the first element is the parent of datetime, and the second element is the parent of HTTPRequest. In the fourth row, datetime is the parent of date and time, and HTTPRequest is the parent of HTTPMethod, URI, and protocol.
    Intelligent Structure Discovery
    creates nodes with unique names. If
    Intelligent Structure Discovery
    discovers instances of the same type of data, it adds a number suffix to the node names. For example, if the input contains timestamps in two tables,
    Intelligent Structure Discovery
    names them
    timestamp1
    and
    timestamp2
    .
  5. When you base the model on an Avro, Parquet, or ORC file,
    Intelligent Structure Discovery
    discovers both the data elements and the elements of the file schema. By default,
    Intelligent Structure Discovery
    excludes elements that appear only in the schema from the model. To add schema elements to the output, include them in the structure of the model. For more information, see Performing actions on multiple nodes.
  6. For a model that you create for an Excel worksheet,
    Intelligent Structure Discovery
    creates metadata nodes with sheet index and name. By default,
    Intelligent Structure Discovery
    excludes those nodes from the structure of the model. To add the nodes to the output, include them in the structure. For more information, see Edit the structure of Microsoft Excel input.
  7. You can refine the structure so that when you use the model in production the output meets your requirements. For more information, see Refining intelligent structure models.
  8. Click
    Save
    .
    Intelligent Structure Discovery
    generates an
    intelligent structure model
    and saves the model in the selected location.

0 COMMENTS

We’d like to hear from you!