Search

Amazon S3 Connector

Amazon S3 Connector

Back Next

Amazon S3 Targets in Mapping Tasks

Amazon S3 Targets in
Mapping
Tasks

For Amazon S3 target connections used in

mapping

tasks, you can configure advanced properties in the

Targets

page of the

Mapping

Task wizard.

You can configure the following advanced properties:

Property	Description
Encryption Type	Method you want to use to encrypt data. Select one of the following values: None. The data is not encrypted. Client Side Encryption. The Secure Agent encrypts data while uploading the delimited files to Amazon buckets. You must select client-side encryption in the advanced properties if you specify a master symmetric key or customer master key ID in the Amazon S3 connection properties. Server Side Encryption. You must select server-side encryption in the advanced properties if you specify a customer master key ID in the Amazon S3 connection properties. If you select the server-side encryption in the advanced properties and do not specify the customer master key ID in the connection properties, Amazon S3-managed encryption keys are used to encrypt data.
Folder Path	The complete path to the Amazon S3 objects and must include the bucket name and any folder name. Ensure that you do not use a forward slash at the end of the folder path. For example, <bucket name>/<my folder name> The folder path specified at run time overrides the path specified while creating a connection.
Compression Type	Compress the data in GZIP format when you write the data to Amazon S3. The target file in Amazon S3 will have .gz extension. The Secure Agent compresses the data and then sends the data to Amazon S3 bucket. Default is None.
Part Size	Specifies the part size of an object. Default is 5 MB.
TransferManager Thread Pool Size	Specifies the number of the threads to write data in parallel. Amazon S3 Connector uses the AWS TransferManager API to upload a large object in multiple parts to Amazon S3. When the file size is more than 5 MB, you can configure multipart upload to upload object in multiple parts in parallel. If you set the value of the TransferManager Thread Pool Size to greater than 50, the value reverts to 50. Default is 10.
Merge Partition Files	Not applicable.
Distribution Column	Specify the name of the column to create multiple target files during run time.
Staging File Location	Amazon S3 staging directory. When you run a task in Secure Agent runtime environment, specify a directory path that is available on the corresponding Secure Agent machine in the runtime environment. When you specify the directory path, the Secure Agent create folders depending on the number of partitions that you specify in the following format: InfaS3Staging<00/11><timestamp>_<partition number> where, 00 represents read operation and 11 represents write operation. For example, InfaS3Staging000703115851268912800_0 The temporary files are created within the new directory. When you specify a directory name, if a folder with same name already exists, the Secure Agent deletes the contents of the folder. You must have the write permission for the specified location. If you do not specify a directory path, the Secure Agent uses a temporary directory as the staging file location. When you run a task in Hosted Agent runtime environment, leave the staging directory location blank. The Hosted Agent creates a directory at a temporary location.
Object Tags	You can add single or multiple tags to the objects stored on the Amazon S3 bucket. You can either enter the key value pairs or specify the file path that contains the key value pairs. For more information, see Object Tag.
Success File Directory	Not applicable.
Error File Directory	Not applicable.

Amazon S3 Objects in Mapping Tasks

Specifying a Target

Watch

Comments

Cloud Connectivity Homepage

0 COMMENTS

We’d like to hear from you! Log in to comment.