Operator Guide

10.4.1
- 10.5
- 10.4.0

Back Next

Automatic Flat File Subscription

Use this type of subscription to consume data into a flat file target if you want

Data Integration Hub

to create the PowerCenter workflow for the subscription.

For subscriptions with a flat file target, define the location of the target files and the expected file format. If you are delivering the files to a Hadoop Distributed File System (HDFS), select the HDFS connection.

If you use the file transfer protocol to move the files, select the file transfer connection.

Data Integration Hub

creates the mapping based on the topic tables that are associated with the file, and based on the fields in the topic structure. Topic tables that are not associated with a file are not mapped. You can edit the mapping of fields and exclude fields and tables. For each table that exists in the mapping, the subscription process generates a file. The file contains only the fields that are mapped from the topic to the target.

The following pages appear in the subscription wizard for this type of subscription:

General. Define basic subscription properties.

Processing.

If you want to run a post-process on the subscription, select a subscription post-processing workflow. If the post-process includes parameters, the parameters appear in this page and are optional. If required, set the values of the parameters.

Join. You can pull data from multiple topic tables into a single target table by creating joins. You can create multiple joins, and you can combine data from joins into new joins.

Target. Choose the target type. For an HDFS target or when you use file transfer, select the connection to the target to which

Data Integration Hub

delivers the data. Enter the location of the file or files into which

Data Integration Hub

writes the data, and configure flat file targets for the topic tables. You must configure a file target for at least one topic table.

Field Mapping. Review the subscription field mapping, and if required, edit the mapping that

Data Integration Hub

generates by default. You can manually map topic tables and fields to target tables and fields.

Filter. Define the data that the subscription consumes by setting filter conditions on table columns.

Schedule. Define the method and the frequency of data consumption. You can select to consume the published data immediately after the data is ready, to run the subscription manually or by an external trigger, or to consume the data according to a schedule that you define.

Delivery. Define the delivery options of the data to consume. For subscriptions that run either manually or by an external trigger or that run by schedule, choose the data delivery scope and delivery format: all available subscriptions, all available subscriptions - aggregated, or the latest subscription only.

For subscriptions that do not use file transfer,

choose how

Data Integration Hub

handles data that exists in the target application: append the new data to the existing data in the target, insert new rows, or overwrite the existing data in the target. For subscriptions where the type of topic to which the subscription subscribes is Full, if you select to append the new data or to insert new rows, you can select to delete rows that don't exist in the topic from the target.

Permissions. Assign categories that restrict access to the subscription. You can assign permission to a subscription only if the associated application has assigned categories. If you do not assign categories to the subscription, it inherits the categories from the associated application. If there are no categories assigned to the application, all

Data Integration Hub

users can access the subscription.

Summary. Review the subscription settings and save the subscription.

Subscription Types

Download Guide

Watch

Comments

Communities

Knowledge Base

Success Portal