Table of Contents


  1. Preface
  2. Components
  3. API collections
  4. Business services
  5. File listeners
  6. Fixed-width file formats
  7. Hierarchical mappers
  8. Hierarchical schemas
  9. Industry data service customizer
  10. Intelligent structure models
  11. Refining intelligent structure models
  12. Mapplets
  13. Saved queries
  14. Shared sequences
  15. User-defined functions



Intelligent Structure Discovery process

Intelligent Structure Discovery

You can create an
intelligent structure
model using
Intelligent Structure Discovery
After you provide an input file,
Intelligent Structure Discovery
determines the underlying and repeating patterns of the data and creates a structure that represents the fields of data and their relationships. You can quickly model data for files whose structure is very hard, time consuming, and costly to find, such as log files, clickstreams, customer web access, error text files, or other internet, sensor, or device data that does not follow industry standards.
The following image shows the process by which
Intelligent Structure Discovery
deciphers the underlying patterns of data and creates a model of the data patterns:
This image shows unstuctured or structured data being deciphered by Intelligent Structure Discovery, which creates a model of the data.
When the model is based on input from a Hadoop Files source,
Intelligent Structure Discovery
determines the data types to use in the model based on the types and structures in the Hadoop schema. In the model,
Intelligent Structure Discovery
creates an array of structures of key-value pairs for data of type map. Nodes of type enum are represented as strings.


We’d like to hear from you!