At run time, the Data Integration Service creates a temporary directory in the location that you set for the
property that you configure for the complex file targets in a streaming mapping. A temporary directory is created for each mapping. A temporary directory contains the target files to which the data is currently written.
Based on the rollover limit, data is written to the target file in the temporary directory. After a target file reaches the specified rollover limit, the target file is closed and moved to the specified target file directory from the temporary directory.
For example, if you set the
, you can find the target file to which data is currently written in the following directory:
directory contains the target files that are moved after the rollover limit is reached.
If a mapping fails, all the target files are closed and moved to the specified target file directory from the temporary directory, and the temporary directory will be deleted. In the preceding example, the temporary directory
will be deleted.
If you use Data Engineering Integration to process batch data, you can use the batch complex files that are created in the file directory as the source objects in Data Engineering Integration.