PowerExchange for HDFS User Guide

10.4.0
- 10.5.9
- 10.5.8
- 10.5.7
- 10.5.6
- 10.5.4
- 10.5.3
- 10.5.1
- 10.5
- 10.4.1

Back Next

Overwriting Complex File Targets

When you run a mapping in the native environment or on the Spark engine to write data to a complex file target, you can choose to overwrite the target data. You can select the

Overwrite Target

option in the advanced write properties of the complex file data object.

If you select the

Overwrite Target

option, the Data Integration Service deletes the target data before writing data. If you do not select this option, the Data Integration Service creates a new file in the target and writes the data to the file.

If you select the

Overwrite Target

option, the Data Integration Service deletes all the files and folders in the target directory that are prefixed with the target file name.

For example, the following image shows target data with Overwrite Fileport connected:

This shows an overwrite fileport connected sample

If you select the

Overwrite Target

option, the Data Integration Service deletes all the folders and files in the target directory that are prefixed with the target file name.

The following image shows the file structure after using the

Overwrite Target

option:

If you do not use the

Overwrite Target

option, the Data Integration Service adds the data to the existing files and folders in the target directory.

The following image shows the file structure when you append data:

this image shows target data with overwrite fileport connected

To avoid unnecessary deletion of files and folders, you must verify that the target directory does not contain any folder or file with the same name as the target file name.

Rename Saved Search

Table of Contents

PowerExchange for HDFS User Guide

PowerExchange for HDFS User Guide

Overwriting Complex File Targets

Overwriting Complex File Targets