User Guide

1.3
- 1.2
- 1.1
- 1.0

Back Next

Filtering Extraction Maps and Source Objects

PowerExchange CDC Publisher uses the pwxExtractionMapSchemaName property value to select the PowerExchange extraction maps to use for extracting change data from source objects. You can filter this set of extraction maps and the source objects that are associated with them by specifying filtering criteria. You can enter filtering criteria that exclusively includes or excludes extraction maps.

To filter extraction maps, enter one or both of the following properties in the cdcPublisherPowerExchange.cfg configuration file:

Extract.captureConsumerIncludeNameList
. Specifies a subset of the selected extraction maps to explicitly include
in extraction processing. For each extraction map to include, enter the full extraction map name in the format xnninstance.mapname_tablename with a comma (,) separator between values, as follows:

Extract.captureConsumerIncludeNameList=xnninstance.mapname_tablename1,xnninstance.mapname_tablename2,...

You can use the asterisk (*) wildcard anywhere in the value to represent one or more characters, thereby creating a mask that matches multiple extraction maps. The PowerExchange CDC Publisher process will use the included extraction maps and ignore any other extraction maps that matched the extraction-map schema name.

Use this parameter when you want to explicitly include some of the selected extraction maps and ignore all of the other extraction maps that matched the pwxExtractionMapSchemaName value.

Extract.captureConsumerExcludeNameList
. Specifies a subset of the selected extraction maps to exclude
from extraction processing. For each extraction map to exclude, enter the full extraction map name in the format xnninstance.mapname_tablename. Use a comma (,) separator between values. You can include the asterisk (*) wildcard anywhere in the value to represent one or more characters, thereby creating a mask that matches multiple extraction maps.

Use this property when you want to use most of the extractions maps that matched the pwxExtractionMapSchemaName value and exclude only those that match the exclusion criteria in this property.

You can use the Extract.captureConsumerIncludeNameList and

Extract.captureConsumerExcludeNameList

properties together. For example, use an

Extract.captureConsumerIncludeNameList

mask to select a subset of extraction maps and then use the Extract.captureConsumerExcludeNameList to narrow the extraction maps in that subset.

For example, assume the following properties are specified:

Extract.pwxExtractionMapSchemaName=d8district1

Extract.captureConsumerIncludeNameList=d8district1.store*

Extract.captureConsumerExcludeNameList=d8district1.store1_sales,

d8district1.store1_customers

, d8district1.store1_items

In this case, all extraction maps that have names beginning with the xnninstance value, or schema name, of "d8district1" are selected. Of the selected extraction maps, you explicitly include only those that have mapname values that begin with "store." From the subset of included extraction maps, you explicitly exclude the three extraction maps for map "store 1."

The PowerExchange CDC Publisher does not automatically exclude extraction maps that are associated with capture registrations that have the status of Inactive, History, or Suspended. If no change data is available, the CDC Publisher does not publish change data for the registered source objects. If you will never use these deactivated capture registrations or their associated extraction maps to capture and publish change data, you can exclude the extraction maps in the CDC Publisher to reduce resource consumption. Before you define the exclusion filter, ensure that any change data that was previously captured for the source object has been published to the target messaging system. After you define the exclusion filter, you must restart the CDC Publisher process for the filter to take effect.

If you use PowerExchange Logger for Linux, UNIX, and Windows log groups, run a PowerExchange CDC Publisher instance for each log group. In CDC Publisher, filter the extraction maps that each CDC Publisher instance uses for extraction processing based on the capture registrations defined for the log group that the instance is processing. Note that the CDC Publisher uses extraction maps for data extraction, whereas the log groups are associated with capture registrations.

Rename Saved Search

Table of Contents

User Guide

User Guide

Filtering Extraction Maps and Source Objects

Filtering Extraction Maps and Source Objects