Table of Contents

Search

  1. Preface
  2. Data integration tasks
  3. Mapping tasks
  4. Dynamic mapping tasks
  5. Synchronization tasks
  6. Data transfer tasks
  7. Replication tasks
  8. Masking tasks
  9. Masking rules
  10. PowerCenter tasks

Tasks

Tasks

Reprocessing incrementally-loaded source files

Reprocessing incrementally-loaded source files

Reprocess source files to create a snapshot of the data from a specified time interval, to debug and discover the source of bad data in your target, or to restore deleted data. In the advanced options, you can configure the properties to reprocess incrementally-loaded source files.
A job that reprocesses incrementally-loaded files reads the files that were modified during the time that you specify. You can choose to reprocess files that were modified in a given time interval or all files modified after a given start time. Reprocessing applies only to Source transformations that you configure to incrementally-load files. The following image shows the reprocessing settings in
Advanced Options
:
Screenshot of the Advanced Options dialog box where you can configure the job to reprocess incrementally loaded source files.
You can reprocess source files when at least one source is configured to incrementally load files and the files have been loaded at least once. The advanced options are not available if the mapping does not have sources configured to incrementally load files, the mapping task has never run, or the mapping task is configured to perform a full load of all files.
Reprocessing doesn't change the time that the mapping task uses in future jobs to identify modified files for incrementally-loaded sources. For example, you have a mapping task that incrementally loads files and is scheduled to run every Monday at 8 a.m. After you run a job with advanced options on a Thursday, the next scheduled job still checks for files modified after Monday at 8 a.m. If you want to change the time that the mapping task uses to identify modified files, override the incremental file load type in the mapping task configuration.
Processing is unpredictable when the start or end time of a reprocessing job is within the repeated hour on the day that Daylight Saving Time ends.

0 COMMENTS

We’d like to hear from you!