Table of Contents

Search

  1. Preface
  2. PowerExchange CDC Publisher Overview
  3. Installing and Upgrading PowerExchange CDC Publisher
  4. PowerExchange CDC Publisher Key Concepts
  5. PowerExchange Change Capture Environment
  6. Target Messaging Systems
  7. Configuring PowerExchange CDC Publisher
  8. Streaming Change Data
  9. Monitoring PowerExchange CDC Publisher
  10. Administering PowerExchange CDC Publisher
  11. Command Reference for the Command-Line Utilities
  12. Avro Schema Formats
  13. Message Reference

User Guide

User Guide

Filtering Extraction Maps and Source Objects

Filtering Extraction Maps and Source Objects

PowerExchange CDC Publisher uses the pwxExtractionMapSchemaName property value to select the PowerExchange extraction maps to use for extracting change data from source objects. You can filter this set of extraction maps and the source objects that are associated with them by specifying filtering criteria. You can enter filtering criteria that exclusively includes or excludes extraction maps.
To filter extraction maps, enter one or both of the following parameters in the cdcPublisherPowerExchange.cfg configuration file:
  • Extract.captureConsumerIncludeNameList
    . Specifies a subset of the selected extraction maps to explicitly
    include
    in extraction processing. For each extraction map to include, enter the full extraction map name in the format
    xnninstance
    .
    mapname_tablename
    . Use a comma (,) separator between the values. For example:
    Extract.captureConsumerIncludeNameList=
    xnninstance
    .
    mapname_tablename
    1,
    xnninstance
    .
    mapname_tablename
    2
    ,...
    You can use the asterisk (*) wildcard anywhere in the value to represent one or more characters, thereby creating a mask that matches multiple extraction maps. The PowerExchange CDC Publisher process will use the included extraction maps and ignore any other extraction maps that matched the extraction-map schema name.
    Use this parameter when you want to explicitly include some of the selected extraction maps and ignore all of the other extraction maps that matched the pwxExtractionMapSchemaName value.
  • Extract.captureConsumerExcludeNameList
    . Specifies a subset of the selected extraction maps to
    exclude
    from extraction processing. For each extraction map to exclude, enter the full extraction map name in the format
    xnninstance
    .
    mapname_tablename
    . Use a comma (,) separator between the values. You can include the asterisk (*) wildcard anywhere in the value to represent one or more characters, thereby creating a mask that matches multiple extraction maps.
    Use this parameter when you want to use most of the extractions maps that matched the pwxExtractionMapSchemaName value, excluding only those that match the exclusion criteria in this property.
You can use the Extract.captureConsumerIncludeNameList and Extract.captureConsumerExcludeNameList properties together. For example, use an Extract.captureConsumerIncludeNameList mask to select a subset of extraction maps and then use the Extract.captureConsumerExcludeNameList to narrow the extraction maps in that subset.
For example, assume the following properties are specified:
  • Extract.pwxExtractionMapSchemaName=d8district1
  • Extract.captureConsumerIncludeNameList=d8district1.store*
  • Extract.captureConsumerExcludeNameList=d8district1.store1_sales, d8district1.store1_customers, d8district1.store1_items
In this case, all extraction maps that have names beginning with the
xnn
instance (schema) value of "d8district1" are selected, where the full extraction map name format is
xnninstance
.
mapname
_
tablename
. Of the selected extraction maps, you explicitly include only those that have
mapname
values that begin with "store." From the subset of included extraction maps, you explicitly exclude the three extraction maps for map "store 1."
The PowerExchange CDC Publisher does not automatically exclude extraction maps that are associated with capture registrations that have the status of Inactive, History or Suspended. If no change data is available, the CDC Publisher does not publish change data for the registered source objects. If you will never use these deactivated capture registrations or their associated extraction maps to capture and publish change data, you can exclude the extraction maps in the CDC Publisher to reduce resource consumption. Before you define the exclusion filter, ensure that any change data that was previously captured for the source object has been published to the target messaging system. After you define the exclusion filter, you must restart the CDC Publisher process for the filter to take effect.

0 COMMENTS

We’d like to hear from you!