Application Ingestion and Replication

Back Next

Configure an SAP source that uses the SAP OData V2 connector

Define source properties for the source that you selected on the

Source

page.

Under

Source Properties

, configure the basic properties:

Property	Description
Load Type	Type of load operation that you want the application ingestion and replication task to perform. You can select one of the following load types for the task: Initial Load : Loads data read at a specific point in time from the source application to the target in a batch operation. You can perform an initial load to materialize a target to which incremental change data will be sent. Incremental Load : Propagates source data changes to a target continuously or until the job is stopped or ends. The job propagates the changes that have occurred since the last time the job ran or from a specific start point for the first job run. Initial and Incremental Load : Performs an initial load of point-in-time data to the target and then automatically switches to propagating incremental data changes made to the same source objects on a continuous basis.
OData Service Name	Select the OData service endpoint from where you want to retrieve data. The list contains a specific SAP service or a list of all available services on the SAP Gateway based on the service type you specified in the SAP OData V2 connection.

Property

Description

Load Type

Type of load operation that you want the

application ingestion and replication

task to perform. You can select one of the following load types for the task:

Initial Load

: Loads data read at a specific point in time from the source application to the target in a batch operation. You can perform an initial load to materialize a target to which incremental change data will be sent.

Incremental Load

: Propagates source data changes to a target continuously or until the job is stopped or ends. The job propagates the changes that have occurred since the last time the job ran or from a specific start point for the first job run.

Initial and Incremental Load

: Performs an initial load of point-in-time data to the target and then automatically switches to propagating incremental data changes made to the same source objects on a continuous basis.

OData Service Name

Select the OData service endpoint from where you want to retrieve data.

The list contains a specific SAP service or a list of all available services on the SAP Gateway based on the service type you specified in the SAP OData V2 connection.

Under

Source Tables

, select the source tables that you want to replicate data from. Use one or both of the following methods:

On the

Selected Tables

tab, individually select the check box for each source table you want to include. Clear the check box for any tables you do not want to include. To select all tables, select the

Table

check box at the top.

The

Column

count for a table shows the total number of columns in the table.

If you select the tables you want to include, all the selected and unselected tables are displayed by default. To view the selected tables only, use the filter next to the table selection count and change the view from

All

Selected

To find tables or columns, you can type all or part of a name in the Find
box and click

. This value is case-sensitive. If you type the beginning of a name only, a wildcard isn't required to represent the remainder. For example, CDC, CD, and CD* return the same results. However, if the search string is within the name, include the wildcard * at the beginning. For example, *CDC returns tables and columns that include CDC anywhere in their names. To narrow the search to only table names or column names, select

Table Name

Columns

in the drop-down list adjacent to the Find
box.

On the

Selection Rules

tab, you can create inclusion and exclusion rules for tables.

To add a table rule, click the plus (+) sign in the upper right corner. In the

Type

field, select

Include

Exclude

as the rule type. Then enter a string, with or without wildcards, as the condition.

Tips:

You can copy an existing table rule to use as a starting point for creating another rule. Click the copy icon at the right end of the row.

You can edit a table rule directly in its row by clicking the

Type

Match Condition

value.

To view the tables and columns that match a single rule, click

View Objects

in the row for the rule. For an Include rule, it shows the objects to be included. For an Exclude rule, it shows the objects to be excluded.

When you define a condition in a rule, use the following guidelines:

The task wizard is case sensitive. Enter the table names or masks in the case with which they were defined.

A mask can contain one or more wildcards. Supported wildcards are: an asterisk (*), which represents one or more characters, and a question mark (?), which represents a single character. A wildcard can occur multiple times in a mask value and can occur anywhere in the value.

Delimiters such as quotation marks or brackets are not allowed, even if the source uses them.

If a table name includes special characters such as a backslash (\), asterisk(*), dollar sign ($), caret (^), or question mark (?), escape each special character with a backslash (\) when you enter the rule.

If you define multiple table rules, they're processed in the order in which they're listed (top to bottom). Be sure to define them in the correct order of processing. For example, if a table rule specifies "Exclude CDC" followed by "Include C", all tables with names beginning with "C" are selected, including the CDC tables.

You can both manually select source tables and define selection rules. If you first manually select tables on the

Selected Tables

tab, rules are generated and displayed for those selections on the

Selection Rules

tab. Similarly, if you first define rules, any tables selected by those rules are displayed as selected on the

Selected Tables

tab.

To configure advanced source properties, toggle on

Show Advanced Options

at the top of the page. Advanced source properties are optional or have default values. Complete the following optional advanced properties as needed:

Property	Description
List Tables by Rule Type	Generate and download a list of the source tables that match the table selection criteria. If you used rule-based table selection, you can select the type of selection rules to use. Options are: Include Rules Only Exclude Rules Only Include And Exclude Rules Select the Include Columns check box to include columns in the list, regardless of which table selection method you used. Click the Download icon to download the list.
Initial Start Point for Incremental Load	For incremental load jobs, customize the position in the source logs from which the application ingestion and replication job starts reading change records the first time it runs.
CDC Interval	For incremental load and combined initial and incremental load jobs, specify the time interval in which the application ingestion and replication job runs to retrieve the change records for incremental load. The default interval is 1 day.
Fetch Size	Enter the number of records that the application ingestion and replication job associated with the task reads at a time from the source.

Under

Custom Properties

, you can specify one or more custom properties that Informatica provides to improve performance or to meet your special requirements. To add a property, click the + icon to add a row. In the

Property Name

field, select a property and then enter a property value, or select the

Custom

option and manuallly enter both the property name and value.

The following table describes the properties that are available, depending on the load type:

Property	Description
Read Event Batch Size	The number of payload events written in batch to the internal event queue during CDC processing. When the event queue is implemented as an internal ring buffer, this value is the number of payload events that the reader writes to a single internal buffer slot. A batch size that's too small might increase contention between threads. A larger batch size can provide for more parallelism but consume more memory.
Reader Helper Thread Count	The number of reader helper threads used during CDC processing to convert change data into a canonical format that can be passed to the target. Default value is 3. You can enter a larger value to allow more threads to be available for performing conversion processing in parallel.
Custom	Select this option to manually enter the name of a property and its value. Use this option to enter properties that Informatica Global Customer Support or a technical staff member has provided to you for a special case. Available for any supported load type.

Custom properties are intended to address performance or special processing needs. A property name can contain only alphanumeric characters and the following special characters: periods (.), hyphens (-), and underscores (_).