Cleanse assets

Back Next

Removing instances of values that appear in a dictionary

You can configure a step to remove instances of values that appear in a dictionary. You might use a dictionary when the list of values to remove is too long to enter as custom values. You might also use a dictionary when you will reuse the list of values in multiple cleanse steps.

On the

Configuration

tab of the cleanse asset, click

Add Step

Select the

Remove Values

option.

In the step properties pane, select

Remove Dictionary Values

Select the dictionary to use in the step.

Click

Browse

to select the dictionary. You can preview the dictionary contents in the Step Properties pane.

Select the valid column for the dictionary. The valid column contains the versions of the dictionary values that you designate as the preferred or correct values for the current operation.

The search operation ignores the values in the valid column. However, if a value in the valid column also appears in another dictionary column, the search operation selects the value for removal.

Select or clear the option to perform a case-sensitive comparison between the dictionary data and the input data.

Verify the delimiter that the mapping will use to recognize discrete values in the input field. You can specify one or more delimiters.

The input delimiter determines how the mapping reads the input data when you select the Start or End option as the scope.

Set the scope for the search operation.

You can set the following options:

Anywhere. Removes any instance of the value that occurs in the input field. Can remove multiple instances of the same value in a field.

Start. Removes any instance of the value that is not preceded by another value in the input field.

End. Removes any instance of the value that is not followed by another value in the input field.

Save the asset.

Step configuration

Download Guide

Watch

Comments

Cloud Data Quality Homepage

0 COMMENTS

We’d like to hear from you! Log in to comment.

Rename Saved Search

Table of Contents

Cleanse assets

Cleanse assets

Removing instances of values that appear in a dictionary

Removing instances of values that appear in a dictionary