Tasks

Back Next

Selecting watermark fields

Data loader

tasks can automatically detect watermark fields for many source types. You can also choose your own watermark fields, or set them as not required.

Watermark fields are date/time or numeric fields that identify the records that were added or changed since the last task run. For example, you might select the MODIFIED_DATE column as the watermark field for a source table. A source object can have one or no watermark fields.

If you want the task to load only new and changed data, you'll need to make sure that watermark fields are configured. If there are no watermark fields, the task processes all fields in the source objects.

Select watermark fields on the

Connect Source

page under

Define Watermark Fields

You can select watermark fields in the following ways:

Automatically detect from source: The task identifies the watermark field automatically in each source object that has one. This is the default option.

If you choose this option but there are no watermark fields in the source objects or the task can't detect the watermark fields, then the task processes all records each time the task runs.
Watermark field not required: Select this option if you want the task to processes all records each time the task runs.
Enter manually: Select this option to choose the watermark field in each source object. If you select this option, you must also specify whether the source objects have the same watermark field or different watermark fields.

If the source objects have the same watermark field, select
The same across all sources
. Then, click
Choose
to select the watermark field.

If the source objects have different watermark fields, select
Different across sources
. Then, click the plus sign (
+
) icon in the
Watermark Fields
area and select the source object and the watermark field. Repeat this process to select watermark fields for other source objects.

The
Watermark Fields
area displays the watermark field for each source object. To update the watermark field for a source object, click the watermark field for that source object. To delete the watermark field for a source object, click the
Delete
icon in the row that contains the source object.

Rename Saved Search

Table of Contents

Tasks

Tasks

Selecting watermark fields

Selecting watermark fields