Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Data Engineering Integration
  3. Mappings
  4. Mapping Optimization
  5. Sources
  6. Targets
  7. Transformations
  8. Python Transformation
  9. Data Preview
  10. Cluster Workflows
  11. Profiles
  12. Monitoring
  13. Hierarchical Data Processing
  14. Hierarchical Data Processing Configuration
  15. Hierarchical Data Processing with Schema Changes
  16. Intelligent Structure Models
  17. Blockchain
  18. Stateful Computing
  19. Appendix A: Connections Reference
  20. Appendix B: Data Type Reference
  21. Appendix C: Function Reference

Example

Example

You are a data architect for an automobile insurance company. Each local branch maintains a database of all their insurance claims. You need to pull collision information from two branches into a single dataset and then verify the accuracy of the data that you moved.
Both input tables contain information about each insurance claim, including a ClaimType. ClaimType is a string value that can be one of a select number of values, including Collision, Property Damage, and Theft. You have a mapping that reads all claim data from each of the branches and writes collision data only to a single target.
Perform the following tasks to audit this data:
1. Define rules.
You first need to calculate the count of collision incidents from each of the sources and the target.
The following table shows the rules that you create:
Name
Transformation
Column
Filter
Type
Execution Override
Branch1_Collisions
Read_Branch1
ClaimType
claim_type = "Collision"
COUNT
Default
Branch2_Collisions
Read_Branch2
ClaimType
claim_type = "Collision"
COUNT
Default
Combined_Collisions
Write_Combined
ClaimType
COUNT
Default
2. Define a condition.
To verify that the combined table contains all collisions from both sources, create a condition to compare the count of the input rows to the count of the output rows.
The following table shows the condition that you create:
Name
Expression
Collision_count_match
Branch1_Collisions + Branch2_Collisions = Combined_Collisions
3. Configure the storage location.
You configure a storage location for the audit results.
4. Run and monitor the mapping.
You select the
Enable Audit
checkbox and then run the mapping.
5. View the results.
In the
Audit Viewer
, you see the following results for the audit rules:
Result
Name
Transformation
Column
Filter
Type
Execution Override
215
Branch1_Collisions
Read_Branch1
ClaimType
claim_type = "Collision"
COUNT
Default
324
Branch2_Collisions
Read_Branch2
ClaimType
claim_type = "Collision"
COUNT
Default
539
Combined_Collisions
Write_Combined
ClaimType
COUNT
Default
You see the following results for the audit condition:
Result
Name
Expression
Passed
Collision_count_match
Branch1_Collisions + Branch2_Collisions = Combined_Collisions

0 COMMENTS

We’d like to hear from you!