Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange Bulk Data Movement
  3. PowerExchange Listener
  4. Adabas Bulk Data Movement
  5. Datacom Bulk Data Movement
  6. DB2 for i5/OS Bulk Data Movement
  7. DB2 for Linux, UNIX, and Windows Bulk Data Movement
  8. DB2 for z/OS Bulk Data Movement
  9. IDMS Bulk Data Movement
  10. IMS Bulk Data Movement
  11. Microsoft SQL Server Bulk Data Movement
  12. Oracle Bulk Data Movement
  13. Sequential File Bulk Data Movement
  14. VSAM Bulk Data Movement
  15. Writing Data with Fault Tolerance
  16. Monitoring and Tuning Options

Bulk Data Movement Guide

Bulk Data Movement Guide

Enabling Offload and Multithreaded Processing for Bulk Data Movement Sessions

Enabling Offload and Multithreaded Processing for Bulk Data Movement Sessions

To use bulk data offload processing and multithreaded processing, you must configure some connection attributes for the bulk data movement session.
For sequential and flat files, VSAM data sets, IMS unload data sets, and DB2 image copies, configure the attributes on the PWX NRDB Batch application connection for the bulk data movement session.
The following table describes the attributes to configure in the PWX NRDB Batch application connection:
Connection Attribute
Description
Offload Processing
Specifies whether to use offload processing to move PowerExchange bulk data processing from the source or target system to the PowerCenter Integration Service.
For data sources, select one of the following values:
  • No
    . Do not use offload processing.
  • Auto
    . PowerExchange determines whether to use offload processing.
  • Filter Before
    . Offload column-level processing to the Integration Service machine, but continue to filter data on the source system.
  • Filter After.
    Offload column-level processing and data filtering to the Integration Service machine.
For data targets, select one of the following values:
  • No
    . Do not use offload processing.
  • Auto
    . Do not use offload processing.
  • Filter Before
    . Use offload processing. Filtering does not apply to offload processing for data targets.
  • Filter After.
    Use offload processing. Filtering does not apply to offload processing for data targets.
Default is No.
Worker Threads
When offload processing is enabled, specifies the number of threads that PowerExchange uses on the Integration Service machine to process bulk data.
For optimal performance, assign a value that is equal to or less than the number of installed or available processors on the PowerCenter Integration Service machine.
Valid values are 1 through 64. Default is 0, which disables multithreading.
Array Size
For VSAM data sets or sequential files, if the
Worker Threads
value is greater than zero, the size of the storage array, in number of records, for the threads.
For DB2 for z/OS image copies, determines the maximum number of memory buffers that might need to be allocated. If zIIP processing is enabled,
Array Size
also specifies how many compressed rows to dispatch to the zIIP processor.
Valid values are 25 through 5000. Default is 25.
Informatica recommends that you use the default value unless you are able to test and quantify whether the extra memory that is allocated to a larger array size has been beneficial and has not degraded server performance. If you are able to make these determinations, Informatica recommends an array size of 500 to 1000 when you enable offload multithreaded processing.
If you specify a large value, have large records, or run many sessions that use multithreaded processing, you might experience memory shortages on the Integration Service machine.
For DB2 for z/OS tables, configure attributes on the PWX DB2zOS relational connection for the bulk data movement session.
The following table describes the attributes to configure on the PWX DB2zOS relational connection:
Connection Attribute
Description
Offload Processing
Specifies whether to use bulk data offload processing to move column-level processing for DB2 data from the source system to the PowerCenter Integration Service machine.
Select one of the following values:
  • No
    . Do not use offload processing.
  • Yes
    . Use offload processing.
  • Auto
    . PowerExchange determines whether to use offload processing.
Default is No.
Worker Threads
When offload processing is enabled, specifies the number of threads that PowerExchange uses on the Integration Service machine to process bulk data.
For optimal performance, this value should not exceed the number of installed or available processors on the Integration Service machine.
Valid values are 1 through 64. Default is 0, which disables multithreading.
Array Size
Specifies the DB2 fetch array size. For more information about DB2 fetch array sizes, see the IBM DB2 documentation.
Valid values are 1 through 100000. Default is 25.
Informatica recommends that you use the default value unless you are able to test and quantify whether the extra memory that is allocated to a larger array size has been beneficial and has not degraded server performance. If you are able to make these determinations, Informatica recommends an array size of 500 to 1000 when you enable offload and multithreaded processing.
If you specify a large value, have large records, or run many sessions that use multithreaded processing, you might experience memory shortages on the Integration Service machine.

0 COMMENTS

We’d like to hear from you!