Using PowerCenter to Process Flat Files in Real Time

Back Next

B2B Data Exchange with Real-time Processing

B2B Data Exchange with real-time processing uses a JMS broker to send files to PowerCenter for real-time processing. B2B Data Exchange watches a directory for a file arrival, places the file name in a JMS message queue, and then passes the message to a PowerCenter real-time session.

Use B2B Data Exchange with real-time processing to process flat file sources midstream in the pipeline when the files must be processed immediately upon arrival.

B2B Data Exchange uses JMS to send documents to PowerCenter real-time sessions. Use the PowerCenter Client to configure the PowerCenter mapping and session for real-time processing.

Complete the following steps to use B2B Data Exchange to run PowerCenter real-time sessions that process flat files:

Add a JMS source definition to the PowerCenter mapping that reads the file path from the JMS message queue.

Add an Unstructured Data transformation to the PowerCenter mapping that receives the file path as input and then reads the file.

Create the PowerExchange for JMS connection objects that the session uses to access the message queue.

Configure the real-time properties for the PowerCenter session.

Export the PowerCenter workflow to an XML file.

In B2B Data Exchange, create the associated workflow.

For more information about B2B Data Exchange with real-time processing, see the

Informatica B2B Data Exchange Developer Guide

B2B Data Exchange with Real-time Processing Example

Acme Stuff, Inc. uses B2B Data Exchange to process thousands of flat files daily that it receives from business partners. The files arrive at different times throughout the day and are small in size. B2B Data Exchange watches a directory for file arrival and starts a PowerCenter workflow and session for each file, which causes a high session initialization time and performance issues. The files must be processed immediately upon arrival.

Instead of running one PowerCenter session for each file, use B2B Data Exchange with real-time processing to run a real-time PowerCenter session to process files continuously. B2B Data Exchange watches for the file arrival, places the file name in a JMS message queue, and passes the file name to a PowerCenter workflow with a real-time session. PowerCenter uses an Unstructured Data transformation available with B2B Data Transformation to read the flat file sources in the pipeline.

Using PowerCenter to Process Flat Files in Real Time

Step 1. Add a JMS Source Definition to the PowerCenter Mapping

Step 2. Add an Unstructured Data Transformation to the PowerCenter Mapping

Step 3. Create PowerExchange for JMS Connection Objects

Step 4. Configure the PowerCenter Session for Real-time Processing

Step 5. Export the PowerCenter Workflow

Step 6. Create the Associated Workflow in B2B Data Exchange

Download Guide

Watch

Comments

Communities

Knowledge Base