Mass Ingestion Applications

Back Next

Configuring a Marketo source

On the

Source

page of the

application ingestion

task wizard, you can specify the objects that you want to ingest and configure the advanced properties for your Marketo source. You can also specify custom properties to address unique environments and special use cases.

In the

Object Selection

section, select

Select All

only if you want to select all source objects and fields for data replication. You cannot edit the selection in subsequent fields.

The

Objects Selected

field shows the count of all selected objects. If you have many source objects, the interface might take a long time to fetch them.

Alternatively, you can use rules to define a subset of source objects to replicate.

To use rules to select the source objects, make sure that the

Select All

check box is cleared and then add rules.

When rule-based selection is used, you can refine the set of selected objects by object under

Object View

and also set an option for trimming spaces in character data.

The default "Include *" rule selects all source objects accessed with the selected connection. To see how many objects are selected by this rule, click the Refresh icon to display the object count in

Total Objects Selected

and click

Apply Rules

to see the object count in

Object View

To add a rule:

Click the Add Rule (+) icon above the first table under

Rules

. A row is added to define a new rule.

In the

Object Rule

field, select

Include

Exclude

to create an inclusion or exclusion rule, respectively.

In the

Condition

column, enter an object name or an object-name mask that includes one or more wildcards to identify the source objects to include in or exclude from object selection. Use the following guidelines:

A mask can contain one or both of the following wildcards: an asterisk (*) wildcard to represent one or more characters and a question mark (?) wildcard to represent a single character. A wildcard can occur multiple times in a mask value and can occur anywhere in the value.

The task wizard is case sensitive. Enter the object names or masks in the case with which the objects were defined.

Do not include delimiters such as quotation marks or brackets, even if the source uses them.

If an object name includes special characters such as a backslash (\), asterisk(*), dollar sign ($), caret (^), or question mark (?), escape each special character with a backslash (\) when you enter the rule.

Define additional rules as needed.

The rules are processed in the order in which they're listed, from top to bottom. Use the arrow icons to change the order.

When finished, click

Apply Rules

Tip:

Click the Refresh icon to the right of the

Updated

timestamp to refresh the

Objects Affected

and

Total Objects Selected

counts.

After you apply rules, if you add, delete, or change rules, you must click

Apply Rules

again. Click the Refresh icon to update the object counts. If you delete all rules without clicking

Apply Rules

, a validation error occurs at deployment, even if the

Object View

list still lists objects. If you switch to

Select All

, the rules no longer appear.

To perform trim actions on the fields of the source objects that were selected based on rules, create field action rules.

Perform the following steps to create a field action rule:

Select

Field Action

as the rule type.

From the adjacent list, select one of the following action types:

LTRIM

. Trims spaces to the left of character field values.

RTRIM

. Trims spaces to the right of character field values.

TRIM

. Trims spaces to the left of and to the right of character field values.

In the condition field, enter a field name or a field-name mask that includes one or more asterisk (*) or question mark (?) wildcards. The value that you enter is matched against fields of the selected source objects to identify the fields to which the action applies.

Click Add Rule
.

You can define multiple rules for different action types or for the same action type with different conditions. The field action rules are processed in the order in which they are listed in the

Rules

list. The rule at the top of the list is processed first. You can use the arrow icons to change the order in which the rules are listed.

Under

Object View

, view the selected objects, including the number of fields in each object and the field names and data types.

If you selected

Select All

, the list of objects is view only.

If you applied rules, you can refine the set of selected objects by clicking the check box next to individual objects. Deselect any objects that you do not want to replicate, or select additional objects to replicate. Click the Refresh icon to update the selected objects count.

The first time you change a check box setting for an object, the rules are no longer in effect. The selections under

Object View

take precedence. However, if you click the Add Rule (+) icon again, the objects that you deselected or selected individually are reflected as new rules in the Rules list and the rules once again take precedence. If you want to return to the

Object View

list, click

Apply Rules

again.

For each object, you can view a list of field names and data types. Click the highlighted number of fields in the

Fields

column to list the fields to the right.

To search for objects and fields, in the drop-down list above

Fields

, select

Object Name

Fields

, or

All

and then enter a search string in the Find
box and click

. You can include a single asterisk (*) wildcard at the beginning or end of the string.

To download a list of source objects that match the selection rules, perform the following steps:

From the

List Objects by Rule Type

list, select the type of selection rule for which you want to download the list of selected source objects.

If you want to include the fields in the list, select

Include Fields

Click the Download icon.

The list of source objects that match the selection rules is downloaded to your local drive.

The information in the downloaded file is in the following format:

status,MARKETO,object_name,object_type,field_name,comment

The following table describes the information in the downloaded file:

Field	Description
status	Indicates whether Mass Ingestion Applications includes or excludes the source object from processing. The possible values are: E . The object is excluded from processing by an Exclude rule. I . The object is included for processing. X . The object is excluded from processing even though it matches the selection rules. The comment field in the file provides details on why the object is excluded.
MARKETO	Name of the source application.
object_name	Name of the source object.
object_type	Type of the source object. The possible values are: O : Indicates an object. F : Indicates a field.
field_name	Name of the source field. This information appears only if you selected the Include Fields check box before downloading the list.
comment	Reason why a source object is excluded from processing even though it matches the selection rules.

Expand the

Advanced

section.

For initial load tasks, in the

Start Date

field, specify the date on which the ingestion job associated with the

application ingestion

task starts reading records from lead and custom objects on the source.

For incremental load tasks, in the

Initial Start Point for Incremental Load

field, specify the point in the source data stream from which the ingestion job associated with the

application ingestion

task starts extracting change records.

You must specify the date and time in Coordinated Universal Time (UTC).

For incremental load tasks and combined initial and incremental load tasks, in the

CDC Interval

field, specify the time interval in which the

application ingestion

job runs to retrieve the change records for incremental load. The default interval is 5 minutes.

In the

Custom Properties

section, you can specify custom properties that Informatica provides for special cases. To add a property, add the property name and value, and then click

Add Property

The custom properties are usually configured to address unique environments and special use cases.

Specify the custom properties only at the direction of Informatica Global Customer Support.

Click

Configuring the source

Download Guide

Watch

Comments

Cloud Mass Ingestion Homepage

Free Trial

Communities

Knowledge Base