Select the

Overwrite File(s) If Exists

option in the Amazon S3 data object write operation properties to overwrite the existing files. By default, the value of the

Overwrite File(s) If Exists

check box is true.

If you select the

Overwrite File(s) If Exists

option, the Data Integration Service deletes the existing files with same file name and creates a new files with the same file name in the target directory.

If you do not select the

Overwrite File(s) If Exists

option, the Data Integration Service does not delete the existing files in the target directory. The Data Integration Service adds the timestamp, process ID, and thread ID at the end of each target file name in the following format:

YYYYMMDD_HHMMSS_processID-YYYYMMDD_HHMMSS_threadID

.

For example, the Data Integration Service renames the target file name in the following format:

output.txt-20210616_175627_85354941112-20210616_175632_88554941121

.

If you select the

Overwrite File(s) If Exists

option on the Spark or Databricks Spark engine, the Data Integration Service splits the existing files into multiple files with same file name. Then the Data Integration Service deletes the split files and creates new files in the target directory.

When you select the

Overwrite File(s) If Exists

option to overwrite an Avro file on the Spark or Databricks Spark engine, the Data Integration Service overwrites the existing file and appends

_avro

to the folder name. For example,

targetfile_avro