Rule specification assets

Back Next

Using status data to identify exception records

To generate status values that identify exceptions, configure an action with a status value of Invalid and use the exception properties to indicate why the records meet your exception criteria. Users who analyze the data in downstream processes can use the data that you add to find the exception records and to understand why they qualify as exceptions.

For example, you might decide to examine the output from a mapping that performed duplicate analysis, on the basis that the output may contain additional duplicate records. Let's say that the deduplicate asset in the mapping applied a match threshold value of 90% to the records.

You decide to identify the records that retuned a match threshold value of 89% in the deduplicate output. You define a rule statement that reads the Out_LinkScore field from the output and updates any records with a score between 89% and 90% as Invalid. Additionally, you define exception properties to add

Major

as the priority value and

Potential Duplicates

as the descriptive text.

Select the primary rule set in a rule specification.

In the rule set properties, click

Rule Logic

Click

Add Rule Statement

Select an input of type float for the rule statement.

If the rule specification does not contain an input that you can use, create an input. Configure the input properties to represent the type of column that contains the business data.

The input represents the Out_LinkScore value.

Select an operator to validate the results of the condition analysis.

To identify input records with a score of 89% and above, select the following operator:

is greater than or equal to

Select the type of condition to apply to the input.

To compare the input data to a float, select the following condition type:

float value

Enter the value to compare to the input data. In this case, enter 0.89.

Select

Add Condition

in the rule statement menu.

The rule specification adds a condition under the current condition and creates an AND relationship between the conditions.

Select the input that you added in step 4.

Select an operator to validate the results of the condition analysis.

To identify input records with a score of below 90%, select the following operator:

is less than

Select the type of condition to apply to the input.

To compare the input data to a float, select the following condition type:

float value

Enter the value to compare to the input data. In this case, enter 0.9.

Select the type of action to apply to the data that satisfies the condition logic.

To return a status value that represents the result of the condition, select the following action type:

status value

Select the status value to return when the input data satisfies the condition. In this case, select Invalid.

Configure the exception properties to add data that describe the status of the record.

Click the

+ Exception

option to open the

Configure Exception Data

dialog box.

Select the

Add Exception Details

option.

Add a priority value. For example, Minor.

Enter a text description.

Click

Save the rule specification.

Business rules and rule statements

Download Guide

Watch

Comments

Cloud Data Quality Homepage

0 COMMENTS

We’d like to hear from you! Log in to comment.

Rename Saved Search

Table of Contents

Rule specification assets

Rule specification assets

Using status data to identify exception records

Using status data to identify exception records