Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Ask INFA.

Table of Contents

Search

  1. Preface
  2. Application Ingestion and Replication

Application Ingestion and Replication

Application Ingestion and Replication

Configure a Google Analytics source

Configure a Google Analytics source

Define source properties for the source that you selected on the
Source
page.
  1. Under
    Source Properties
    , configure the basic properties:
    Property
    Description
    Load Type
    Type of load operation that you want the
    application ingestion and replication
    task to perform. You can select one of the following load types for the task:
    • Initial Load
      : Loads data read at a specific point in time from the source application to the target in a batch operation. You can perform an initial load to materialize a target to which incremental change data will be sent.
    • Incremental Load
      : Propagates source data changes to a target continuously or until the job is stopped or ends. The job propagates the changes that have occurred since the last time the job ran or from a specific start point for the first job run.
    • Initial and Incremental Load
      : Performs an initial load of point-in-time data to the target and then automatically switches to propagating incremental data changes made to the same source objects on a continuous basis.
    Account ID
    Enter the unique identifier of your Google Analytics service account.
    Property ID
    Enter the unique identifier of the property whose data you want to replicate.
    View ID
    Enter the unique identifier of the view whose data you want to replicate.
    Path to Report Configuration File
    The path to the JSON file that contains the report configurations.
  2. Under
    Source Reports
    , select the source reports that you want to replicate data from. Use one or both of the following methods:
    • On the
      Selected Reports
      tab, individually select the check box for each source report you want to include. Clear the check box for any reports you do not want to include. To select all reports, select the
      Report
      check box at the top.
      The
      Column
      count for a report shows the total number of columns in the report.
      If you select the reports you want to include, all the selected and unselected reports are displayed by default. To view the selected reports only, use the filter next to the report selection count and change the view from
      All
      to
      Selected
      .
      To find reports or columns, you can type all or part of a name in the
      Find
      box and click
      Search
      . This value is case-sensitive. If you type the beginning of a name only, a wildcard isn't required to represent the remainder. For example, CDC, CD, and CD* return the same results. However, if the search string is within the name, include the wildcard * at the beginning. For example, *CDC returns reports and columns that include CDC anywhere in their names. To narrow the search to only report names or column names, select
      Report Name
      or
      Columns
      in the drop-down list adjacent to the
      Find
      box.
    • On the
      Selection Rules
      tab, you can create inclusion and exclusion rules for reports.
      To add a report rule, click the plus (+) sign in the upper right corner. In the
      Type
      field, select
      Include
      or
      Exclude
      as the rule type. Then enter a string, with or without the wildcards, as the condition.
      Tips:
      • You can copy an existing report rule to use as a starting point for creating another rule. Click the copy icon at the right end of the row.
      • You can edit a report rule directly in its row by clicking the
        Type
        or
        Match Condition
        value.
      • To view the reports and columns that match a single rule, click
        View Objects
        in the row for the rule. For an Include rule, it shows the reports to be included. For an Exclude rule, it shows the reports to be excluded.
      When you define a condition in a rule, use the following guidelines:
      • The task wizard is case sensitive. Enter the report names or masks in the case with which they were defined.
      • A mask can contain one or more wildcards. Supported wildcards are: an asterisk (*), which represents one or more characters, and a question mark (?), which represents a single character. A wildcard can occur multiple times in a mask value and can occur anywhere in the value.
      • Delimiters such as quotation marks or brackets are not allowed, even if the source uses them.
      • If a report name includes special characters such as a backslash (\), asterisk(*), dollar sign ($), caret (^), or question mark (?), escape each special character with a backslash (\) when you enter the rule.
      If you define multiple report rules, they're processed in the order in which they're listed (top to bottom). Be sure to define them in the correct order of processing. For example, if a report rule specifies "Exclude CDC" followed by "Include C", all reports with names beginning with "C" are selected, including the CDC report.
    You can both manually select source reports and define selection rules. If you first manually select reports on the
    Selected Reports
    tab, rules are generated and displayed for those selections on the
    Selection Rules
    tab. Similarly, if you first define rules, any reports selected by those rules are displayed as selected on the
    Selected Reports
    tab.
  3. To configure advanced source properties, toggle on
    Show Advanced Options
    at the top of the page. Advanced source properties are optional or have default values. Complete the following optional advanced properties as needed:
    Property
    Description
    List Reports by Rule Type
    Generate and download a list of the source reports that match the report selection criteria.
    If you used rule-based report selection, you can select the type of selection rules to use. Options are:
    • Include Rules Only
    • Exclude Rules Only
    • Include And Exclude Rules
    Select the
    Include Columns
    check box to include columns in the list, regardless of which report selection method you used.
    Click the
    Download
    icon to download the list.
    Start Date
    For initial load and combined initial and incremental load jobs, specify the date and time when the ingestion job should start replicating the source data.
    End Date
    For initial load jobs, specify the date and time when the ingestion job should stop replicating the source data.
    Initial Start Point for Incremental Load
    For incremental load jobs, specify the point in the source data stream from which the ingestion job associated with the
    application ingestion and replication
    task starts extracting change records.
    You must specify the date in the time zone configured for the Google Analytics view.
    CDC Interval
    For incremental load and combined initial and incremental load jobs, specify the time interval in which the
    application ingestion and replication
    job runs to retrieve the change records for incremental load.
    The default interval is 1 day.
    Fetch Size
    Enter the number of records that the
    application ingestion and replication
    job associated with the task reads at a time from the source.
    The default value is 50000.
  4. Under
    Custom Properties
    , you can specify one or more custom properties that Informatica provides to improve performance or to meet your special requirements. To add a property, click the + icon to add a row. In the
    Property Name
    field, select a property and then enter a property value, or select the
    Custom
    option and manuallly enter both the property name and value.
    The following table describes the properties that are available, depending on the load type:
    Property
    Description
    Read Event Batch Size
    The number of payload events written in batch to the internal event queue during CDC processing.
    When the event queue is implemented as an internal ring buffer, this value is the number of payload events that the reader writes to a single internal buffer slot.
    A batch size that's too small might increase contention between threads. A larger batch size can provide for more parallelism but consume more memory.
    Reader Helper Thread Count
    The number of reader helper threads used during CDC processing to convert change data into a canonical format that can be passed to the target.
    Default value is 3. You can enter a larger value to allow more threads to be available for performing conversion processing in parallel.
    Custom
    Select this option to manually enter the name of a property and its value. Use this option to enter properties that Informatica Global Customer Support or a technical staff member has provided to you for a special case. Available for any supported load type.
    Custom properties are intended to address performance or special processing needs. A property name can contain only alphanumeric characters and the following special characters: periods (.), hyphens (-), and underscores (_).
    To delete a custom property after you've entered it, click the Delete icon at the right end of the property row.
  5. Click
    Next
    to proceed to Step 2 of Task Details.

0 COMMENTS

We’d like to hear from you!