Table of Contents

Search

  1. Preface
  2. Understanding Pipeline Partitioning
  3. Partition Points
  4. Partition Types
  5. Pushdown Optimization
  6. Pushdown Optimization and Transformations
  7. Real-time Processing
  8. Commit Points
  9. Row Error Logging
  10. Workflow Recovery
  11. Stopping and Aborting
  12. Concurrent Workflows
  13. Grid Processing
  14. Load Balancer
  15. Workflow Variables
  16. Parameters and Variables in Sessions
  17. Parameter Files
  18. FastExport
  19. External Loading
  20. FTP
  21. Session Caches
  22. Incremental Aggregation
  23. Session Log Interface
  24. Understanding Buffer Memory
  25. High Precision Data

Advanced Workflow Guide

Advanced Workflow Guide

Change Data from PowerExchange CDC Sources

Change Data from PowerExchange CDC Sources

Use PowerExchange Change Data Capture (CDC) to make the latest changes to online transaction processing systems and databases available to data warehouses, operational data stores, and applications that are used for making timely business decisions
PowerExchange CDC can capture change data from committed transactions on a variety of relational and non-relational sources on i5/OS, Linux, UNIX, Windows, and z/OS systems. PowerExchange captures inserts, updates, and deletes as they occur on the selected source objects and stores the changes in the real-time change stream or PowerExchange Logger log files until the PowerExchange Client for PowerCenter (PWXPC) component requests the change data.
The PWXPC plugin is installed with PowerCenter and requires a local installation of PowerExchange. PWXPC works with the PowerCenter Integration Service and Client tools to run real-time sessions for a specific period of time or continuously. The PowerExchange Listener runs on or off the source system. The following image shows a simple PowerExchange and PowerCenter configuration:
In this sample configuration, PowerExchange captures change data from three sources on different platforms and passes the data to PWXPC by way of the SCLI. PWXPC passes the change data to PowerCenter for processing and transmittal to a target.
The following process flow summarizes PowerExchange interaction with PowerCenter:
  1. PowerExchange captures change data from the source tables and columns that you select, as the changes occur.
  2. A PowerCenter workflow that contains PowerExchange sources and uses a PWX CDC Real Time application connection starts.
  3. PWXPC connects to PowerExchange through the PowerExchange Call Level Interface (SCLI) to retrieve change data through the PowerExchange Listener, on behalf of the workflow.
  4. PowerExchange extracts the change data from the change stream for all sources in the mapping and passes the data to PWXPC.
  5. PWXPC passes the change data to the Integration Service.
  6. The PowerCenter workflow processes and transforms the change data.
  7. A PowerCenter or PowerExchange writer writes the change data to one or more targets.


Updated November 14, 2019