Table of Contents

Search

Amazon S3 Data Object Write Operation

Amazon S3 Data Object Write Operation

Create a mapping to write data to Amazon S3. Change the connection to an Amazon S3 connection, and define the write operation properties to write data to Amazon S3.
There is no control over the number of files created or file names written to the directory on the Spark engine. The Data Integration Service writes data to multiple files based on the source or source file size to the directory provided. You must provide the target file name and based on target file name, the Data Integration Service adds suffix characters such as MapReduce or Split information to the target file name.
If the file size is greater than 256 MB, the Data Integration Service creates multiple files inside the target folder. For example,
output.txt-m-00000
,
output.txt-m-00001
, and
output.txt-m-00002
.


Updated July 30, 2020