The Deduplicate transformation adds a deduplicate asset that you created in
Data Quality
to a mapping.
Use a Deduplicate transformation to analyze the levels of duplication in a data set and optionally to consolidate sets of duplicate records into a single, preferred record. Deduplicate transformations analyze the
identity
information in the records. An identity is a group of data values in a record that identify a person or an organization.
Deduplication and consolidation are useful operations in the following types of data project:
Customer Relationship Management. For example, a store designs a mail campaign and must check the customer database for duplicate customer records.
Regulatory compliance initiatives. For example, a business operates under government or industry regulations that insist all data systems are free of duplicate records.
Financial risk management. For example, a bank may want to search for relationships between account holders.
Any project that must identify or eliminate records that store duplicate identity information.
ASK INFAPreview
