Table of Contents

Search

  1. Preface
  2. Components
  3. Business services
  4. File listeners
  5. Fixed-width file formats
  6. Hierarchical schemas
  7. Intelligent structure models
  8. Mapplets
  9. Saved queries
  10. Shared sequences
  11. User-defined functions

Components

Components

Discovering a file structure and creating an intelligent structure model

Discovering a file structure and creating an
intelligent structure model

Create an
intelligent structure model
to parse data in a semi-structured or unstructured file. Use a simplified sample file to generate the model.
  1. Click
    New
    Components
    Intelligent Structure Model
    , and then click
    Create
    .
  2. On the
    Intelligent Structure Model
    page, enter a name for the
    intelligent structure model
    .
    The name can contain alphanumeric characters and underscores.
  3. Select a location. Navigate to the project and folder where you want to save the
    intelligent structure model
    , or use the default folder.
    You can change the name or location after you save the
    intelligent structure model
    using the
    Explore
    page.
  4. Browse for a file on which to base the model and click
    Discover Structure
    .
    Intelligent Structure Discovery
    deciphers the data in the sample file and discovers the patterns expressed in the data. The following image shows a sample discovered structure on the
    Visual Model
    tab:
    The Visual Model tab shows a sample discovered structure with a hierarchy of nodes. In the top row, table is the parent of element. In the second row, element is the parent of IP, value, token, element, element, statusCode, and number. In the third row, the first element is the parent of datetime, and the second element is the parent of HTTPRequest. In the fourth row, HTTPRequest is the parent of HTTPMethod, URI, and protocol.
    Intelligent Structure Discovery
    creates nodes with unique names. If
    Intelligent Structure Discovery
    discovers instances of the same type of data, for example a timestamp in two tables, it will assign node names with a number suffix to distinguish between the names, for example
    timestamp1
    and
    timestamp2
    .
  5. To refine the
    intelligent structure
    and customize the nodes in the output data, right-click a node and select an action. The menu includes the actions that are relevant for the node. When you perform an action on a node, the action affects the output group that contains the node.
    For more information, see Refining a Discovered Structure.
  6. To add a prefix or a suffix to a field name or to multiple field names, perform the following actions:
    1. Search for the field name or for a part of the field name in the
      Find
      pane.
      Fields names that match the search appear in the
      Find
      pane.
    2. Select the fields to which to add the prefix or suffix, and then, from the
      Actions
      menu, select
      Add Prefix
      or
      Add Suffix
      .
    3. Enter the prefix or suffix in the text field to the right of the
      Actions
      menu, and then click
      Apply to Selected
      .
      The prefix or suffix can contain alphanumeric characters and underscores.
    Intelligent Structure Discovery
    adds a prefix or a suffix to the names of the selected fields.
  7. For an
    intelligent structure
    that is based on a sample JSON file, you can use additional JSON sample files to enrich the structure with new data discovered in the sample files.
    The new nodes are listed in the
    Find
    pane and highlighted in the model.
  8. For an
    intelligent structure
    created for an Excel worksheet, metadata nodes with sheet index and name are created and are excluded from the model by default. Select
    Include in Structure
    to add those nodes to the output.
  9. To view the output groups, select the
    Table
    tab, select the output group, and select an action to perform.
    When you perform an action on a column in an output group, the action applies to the related node in the intelligent structure.
  10. Click
    Save
    .
    Intelligent Structure Discovery
    generates
    .amodel
    intelligent structure model
    , and saves the asset in the selected project and folder.


Updated August 03, 2020