Taskflows

Back Next

Overriding parameters or parameter files in a Data Task step

If the Data Task step uses a

mapping

task with a flat file source, you can override the parameter values that are set in the task. If the Data Task step uses a

mapping

task, you can override the native data type, default precision, and default scale. If the Data Task step uses a

mapping

task available on the Secure Agent machine, you can override the parameter file directory or parameter file name set in the mapping task. If the Data Task step uses a

mapping

task available in a cloud-hosted repository, you can override the parameter file connection and parameter file object set in the mapping task.

Perform the following steps to use a Data Task step to override a

Data Integration

parameter or parameter file:

Create a taskflow and add a Data Task step.

Add a task that contains parameters or uses a parameter file to the Data Task step.

Go to

Data Task

Input Fields

Click

Add

Perform one of the following steps:

To override the parameter file directory or parameter file name of a mapping task that is available on the Secure Agent machine, expand the

Task Properties Parameters

list. Then, select

Parameter File Directory

Parameter File Name

If the object that you want to override is under a directory, use double forward slashes (//) or %2F from the third-level onwards in the file path. For example, to override input1.csv, which is located under

infa.bucket/flat_file_dir/parameters/input1.csv

, use one of the following formats:

infa.bucket/flat_file_dir//parameters//input1.csv

infa.bucket/flat_file_dir%2F/parameters%2F/input1.csv

To override an input parameter or in-out parameter of a

mapping

task, expand the

Input Parameters

InOut Parameters

list. Then, navigate to and select the parameter that you want to override.

To override the parameter file connection and parameter file object of a mapping task that is available in a cloud-hosted repository, expand the

Task Properties Parameters

list. Then, select

Parameter File Connection

and

Parameter File Object

When you configure the Data Task step to override the parameter file connection and parameter file object, you must ensure that both the parameters, that is, source object and source connection are passed either through the parameter file or taskflow. Otherwise, an error occurs.

To override the native data type, default precision, or default scale of the source data of a mapping task, expand the

Input Parameters

Sources

Source

list. Then, select

Source_defaultNativeDataType

Source_defaultPrecision

, or

Source_defaultScale

respectively.

The values set in the Source list take precedence over the values set in the mapping task and the data format field in the Data Task step. If the values in the Source list are incompatible with the values set in the mapping task and the data format field in the Data Task step, the job might fail. The default precision and scale values are applied to all the columns in the formatting file.

To override the values in the

Update Columns

field that is defined in the target of the mapping task, expand the

Input Parameters

Targets

Target

list. Then, select

updateColumns

. You can enter multiple column names separated by commas enclosed within or without double quotes.

You can override the

Update Columns

field only if the mapping task uses an update or upsert operation.

Click

Edit

The

Edit Value

dialog box appears.

Under

Source

, select

Content

. For advanced use cases, you might select

Field

Formula

Under

Value

, enter the new value that you want to override the default value with.

For data format,

Formula

is selected by default, and the payload appears within a single quote in the

Value

field. You can click

f(x)

and override the values in the Expression Editor. Alternatively, you can select

Field

if the field contains the payload. However, the field that you choose must contain the payload using

Formula

within a single quote in the Assignment step.

Click

Overriding parameters in a taskflow

Download Guide

Watch

Comments

Communities

Knowledge Base

Success Portal

0 COMMENTS

We’d like to hear from you! Log in to comment.

Rename Saved Search

Table of Contents

Taskflows

Taskflows

Overriding parameters or parameter files in a Data Task step

Overriding parameters or parameter files in a Data Task step