Tasks

Back Next

Configuring sources

Configure source and lookup source parameters on the

Sources

page. The

Sources

page displays differently based on the basis for the task. If the mapping does not include source or lookup parameters, the

Sources

page does not appear.

You can add a single source object or multiple source objects based on the connection type and mapping configuration.

If the mapping specifies a connection parameter, and after you create the mapping task you edit the mapping to change the source, you might need to edit the task. Check the specific connection in the mapping task to determine if you need to reset it, and then validate the task again.

For each source or lookup source parameter, configure the following details as required:

Parameter detail	Description
Connection	Select a connection. To create a connection, click New . To edit a connection, click View , and in the View Connection dialog box, click Edit . Hover over the source connection tool tip to view more information about the connection.
Source type	Source type. The options available depend on the connection type.
Object	Select an object or enter a query. If a list of objects doesn't appear, click Select . The Select Source Object dialog box displays up to 200 objects. If the object you want to use doesn't appear, enter a search string to reduce the number of objects. Hover over the source object tool tip to view more information about the object.
Display Technical Field Names Instead of Labels	Displays technical names instead of business names. Not available for all connection types.
Add Currently Processed File Name	Adds the source file name to each row. Data Integration adds the CurrentlyProcesedFileName field to the source at run time. Available for parameterized source objects with flat file connections.

Configure formatting options if required.

The properties available vary based on the connection type. For information about a particular connector's properties, see the help for the appropriate connector.

Optionally, expand the

Data Preview

area to preview the data.

To display fields in alphabetical order, click

Display fields in alphabetical order

. By default, fields appear in the order returned by the source system.

To download the preview results, click

Download

For parameterized source objects, configure data filters if necessary.

For parameterized source objects, configure sort options if necessary.

Configure field metadata if required.

You can configure field metadata for sources with certain connection types. To see if a connector supports field metadata configuration, see the help for the appropriate connector. You can't update field metadata in mapping tasks that are based on mappings in SQL ELT mode.

To edit field metadata, expand the

Field Data Types

area and select the row that contains the field that you want to edit. Configure the following attributes:

Data type attribute	Description
Retain existing fields at runtime	When enabled, the task uses the field metadata that is configured in the task. If field metadata changes after a task is saved, Data Integration uses the updated field metadata. Typically, this is the desired behavior. However, if the task uses a flat file connection and you want to retain the metadata used at design time, enable this option.
Type	The data type of the field.
Precision	Total number of digits in a number. For example, the number 123.45 has a precision of 5. The precision must be greater than or equal to 1.
Scale	Number of digits to the right of the decimal point of a number. For example, the number 123.45 has a scale of 2. Scale must be greater than or equal to 0. The scale of a number must be less than its precision. The maximum scale for a numeric data type is 65535. Not editable for all data types.

Optionally, configure advanced options for the selected connection.

The options available depend on the connection.

When you edit advanced options, you can restore default values for individual properties or for all advanced properties. Default values are defined in the mapping that the task is based on.

For information about a particular connector's properties, see the help for the appropriate connector.

Optionally, configure partitions.

The partitioning methods that you can select depend on the connection.

If you defined partitions in the mapping, the partition details are displayed in the

Partitions

area. You can edit these details to override the partitions configured in the mapping at run time.

Click

Mapping task configuration

Download Guide

Watch

Comments

Cloud Data Integration Homepage