In token parsing mode, the Parser transformation parses strings that match data in token sets, regular expressions, probabilistic models, or reference table entries.
To perform token parsing, add strategies on the
Strategies
view of the transformation. You can add one or more operations to each strategy. The transformation provides a wizard that you use to create strategies.
You can add the following types of operations to a token parsing strategy:
Parse using Token Set
Use predefined or user-defined token sets to parse input data. Token set operations can use custom regular expressions that write data to one or more outputs.
You can also use probabilistic models to identify and parse input data values.
Parse using Reference Table
Use reference tables to parse input data.
The transformation performs the operations in the order in which they appear in the strategy.