Table of Contents

Search

  1. Preface
  2. Understanding Pipeline Partitioning
  3. Partition Points
  4. Partition Types
  5. Pushdown Optimization
  6. Pushdown Optimization and Transformations
  7. Real-time Processing
  8. Commit Points
  9. Row Error Logging
  10. Workflow Recovery
  11. Stopping and Aborting
  12. Concurrent Workflows
  13. Grid Processing
  14. Load Balancer
  15. Workflow Variables
  16. Parameters and Variables in Sessions
  17. Parameter Files
  18. FastExport
  19. External Loading
  20. FTP
  21. Session Caches
  22. Incremental Aggregation
  23. Session Log Interface
  24. Understanding Buffer Memory
  25. High Precision Data
  26. POWERCENTERHELP

Advanced Workflow Guide

Advanced Workflow Guide

Configuring for File Partitioning

Configuring for File Partitioning

After you create partition points and configure partitioning information, you can configure source connection settings and file properties on the Transformations view of the Mapping tab. Click the source instance name you want to configure under the Sources node. When you click the source instance name for a file source, the Workflow Manager displays connection and file properties in the session properties.
You can configure the source file names and directories for each source partition. The Workflow Manager generates a file name and location for each partition.
The following table describes the file properties settings for file sources in a mapping:
Attribute
Description
Input Type
Type of source input. You can choose the following types of source input:
  • File. For flat file, COBOL, or XML sources.
  • Command. For source data or a file list generated by a command.
You cannot use a command to generate XML source data.
Concurrent read partitioning
Order in which multiple partitions read input rows from a source file. You can choose the following options:
  • Optimize throughput. The Integration Service does not preserve input row order.
  • Keep relative input row order. The Integration Service preserves the input row order for the rows read by each partition.
  • Keep absolute input row order. The Integration Service preserves the input row order for all rows read by all partitions.
Source File Directory
Directory name of flat file source. By default, the Integration Service looks in the service process variable directory, $PMSourceFileDir, for file sources.
If you specify both the directory and file name in the Source Filename field, clear this field. The Integration Service concatenates this field with the Source Filename field when it runs the session.
You can also use the $InputFile
Name
session parameter to specify the file location.
Source File Name
File name, or file name and path of flat file source. Optionally, use the $InputFile
Name
session parameter for the file name.
The Integration Service concatenates this field with the Source File Directory field when it runs the session. For example, if you have “C:\data\” in the Source File Directory field, then enter “filename.dat” in the Source Filename field. When the Integration Service begins the session, it looks for “C:\data\filename.dat”.
By default, the Workflow Manager enters the file name configured in the source definition.
Source File Type
You can choose the following source file types:
  • Direct. For source files that contain the source data.
  • Indirect. For source files that contain a list of files. When you select Indirect, the Integration Service finds the file list and reads each listed file when it runs the session.
Command Type
Type of source data the command generates. You can choose the following command types:
  • Command generating data for commands that generate source data input rows.
  • Command generating file list for commands that generate a file list.
Command
Command used to generate the source file data.
Truncate string null
Strips the first null character and all characters after the first null character from string values.
Enable this option for delimited flat files that contain null characters in strings. If you do not enable this option, the PowerCenter Integration Service generates a row error for any row that contains null characters in a string.
Default is disabled.


Updated July 04, 2018