Cleanse assets

Back Next

Cleanse process flow

To cleanse your data, you configure and run assets in Data Quality and in Data Integration.

The following image shows the steps involved in the cleansing process:

The image lists the following steps in a sequence: understand the content of the source data, configure a Cleanse asset in Data Quality, add the Cleanse asset to a mapping in Data Integration, and run the mapping.

The cleansing process includes the following steps:

Analyze the content of the source data, so that you can identify the fields that require cleanup. Work with a developer or data steward to understand the data sets. You will create inputs that represent the source data columns in the cleanse asset instances.

During your analysis, perform the following steps:

Verify your business requirements.

Verify the content and structure of your data.

Determine the sequence of the cleanse operations to apply to the data.

In Data Quality, configure a cleanse asset to translate your business requirements into one or more cleanse instances. The input fields within an instance are processed through the logic that you define in a particular instance.

To configure the asset, perform the following steps:

Add one or more instances for the input fields that need cleansing in the source data.

Configure one or more steps for the input fields that each instance identifies.

Optionally, configure the merge operation for the input fields.

In Data Integration, define a mapping that can run the cleansing operation:

Add the Cleanse asset to a Cleanse transformation.

Connect the cleanse asset input and output fields to the upstream and downstream objects in the mapping.

Run the mapping.

The Cleanse transformation does not identify the instance on which each asset input originates. If you define multiple instances on the asset in Data Quality, make a record of the instances to which each input belongs. Use the record as a guide when you connect the asset inputs to the transformation input fields.

Cleanse configuration

Download Guide

Watch

Comments

Cloud Data Quality Homepage