Bulk Data Movement Guide

10.5.4
- 10.5.6
- 10.5.5
- 10.5.3
- 10.5.2
- 10.5.1
- 10.5
- 10.4.1
- 10.4.0 HotFix 1
- 10.4.0

Back Next

Configuring Pass-Through Writer Partitioning

Complete the following steps to configure pass-through writer partitioning for bulk data movement sessions that have VSAM or sequential file targets. In these steps, you customize connection attributes, add partitions, and configure session properties for writer partitions.

In the Workflow Manager, create or open a PWX NRDB Batch application connection as follows:

Click

Connections

Application

The

Application Connection Browser

dialog box appears.

In the

Select Type

list, select

PWX NRDB Batch

Select a connection object in the

Objects

list and click

Edit

. Or click

New

to create a connection.

In the

Connection Object Definition

dialog box, configure connection attributes.

The following table describes attributes that affect writer partitioning:

Attribute	Description
Offload Processing	Controls whether offload processing is used. Enter one of the following options: No . Do not use offload processing. Auto . Allow PowerExchange to determine whether to use offload processing. Filter After . Offload the record-level processing to the PowerCenter Integration Service machine but continue to filter data on the target system. Filter Before . Offload the record-level processing and filtering to the PowerCenter Integration Service machine. Default is No . For partitioned sessions, select Filter Before to optimize performance.
Worker Threads	Controls whether multithreaded processing is used. Enter 0 to disable multithreaded processing. You cannot use multiple worker threads with reader or writer partitions.
Array Size	Storage array size, in number of records, that is shared across the partitions. Enter a valid value from 1 through 5000. You might need to adjust the array size to tune the partitioned bulk data movement session. Default is 25.
Write Mode	Controls whether the joiner sends data from the writer partitions synchronously or asynchronously to the target. Select one of the following options: Confirm Write On . The joiner sends data synchronously across the network to the PowerExchange Listener on the target. The joiner waits for confirmation from the PowerExchange Listener before sending more data. If the PowerExchange Listener encounters errors, it returns error messages to the partitions. This option provides better recovery from errors but might slow data transfer. Confirm Write Off . The joiner sends data asynchronously across the network to the target until encountering an end-of-file (EOF) or an error due to an old block of data. When an error occurs, the session might fail with an error message that reports incorrect record information such as the record number, record data, or number of records processed. This option provides faster data transfer but makes recovery from errors more difficult. Select this option only if you can load the target file with data again if an error occurs. Default is Confirm Write On .
PWX Override	Enter the following override value to use an alternative error-handling method for errors returned from the PowerExchange Listener: WRT_ERROR_HANDLING=Y The alternative method might be more efficient when the Write Mode connection attribute is set to Confirm Write On and input data for the writer partitions contains many errors. Do not specify this override unless these conditions exist. You can also specify the WRT_ERROR_HANDLING statement in the dbmover.cfg file on the PowerCenter Integration Service machine.

Click

. Then click

In the Task Developer, double-click the session.

The

Edit Tasks

dialog box appears.

On the

Mapping

tab, click the

Partitions

tab to display the partition view.

Select the VSAM or sequential file target, and click

Edit Partition Point

The

Edit Partition Point

dialog box appears.

To add a partition, click

Add

and select

Pass Through

as the partition type. You can also add a description.

After you add all of the partitions, click

On the

Mapping

tab, click the

Transformation

tab to display the transformation view.

Verify that the target is selected.

In the

Connections Value

field, select a PWX NRDB Batch application connection.

Under

Properties

, select one of the following options in the

PWX Partition Strategy

list:

Single Connection

. PowerExchange creates a single connection to the data target. Any overrides specified for the first partition are used for all partitions. If you specify any overrides for other partitions that are different from the overrides for the first partition, the session fails with an error message.

Overrides Driven

. If the specified overrides are the same for all partitions, PowerExchange creates a single connection to the data target. If the overrides are not identical for all partitions, PowerExchange creates multiple connections.

Set optional override properties at the session level or partition level, based on the target type and property.

If you selected

Single Connection

for the

PWX Partition Strategy

property, you can enter overrides for the first partition only. The PowerCenter Integration Service then uses them for all partitions in the session.

The following table describes the session-level and partition-level session properties that pertain to writer partitions:

Property	Description	Target Type	Level
File Name Override	Specifies a fully qualified data set name that overrides the data set name in the PowerExchange data map.	Sequential files and VSAM	Partition level
Insert Only	Processes SQL updates and deletes as inserts. You must select this option when the target does not have keys.	VSAM	Session level
Insert SQL Override	Specifies insert SQL that overrides the default insert SQL sent to PowerExchange.	Sequential files and VSAM	Partition level
Pre SQL	Specifies SQL statements that run before the session with the target database connection.	Sequential files and VSAM	Partition level
Post SQL	Specifies SQL statements that run after the session with the target database connection.	Sequential files and VSAM	Partition level
Truncate Table Option	Truncates the target contents before loading bulk data. VSAM data sets must be defined with the REUSE option for truncation to function correctly.	VSAM	Session level