Amazon S3 Connector

Amazon S3 Connector

Amazon Targets in Synchronization Tasks

Amazon Targets in
Synchronization
Tasks

When you configure a
synchronization
task to write to an Amazon target, you can configure the target properties.
The target properties appear on the
Target
page of the
Synchronization
Task wizard.
The following table describes the Amazon target properties:
Source Property
Description
Connection
Name of the target connection.
Target Object
Specify the target object for the task.
Formatting Options
Amazon S3 format options. Opens the
Formatting Options
dialog box to define the format of the file. Default is delimited.
Configure the following format options:
  • Delimiter: Delimiter character. You can configure other parameters such as comma, tab, colon, semicolon, or others.
  • Text Qualifier: Character to qualify text. You can configure other parameters such as single quote or double quote.
  • Escape: Escape character.
Create Target
Creates a target. Enter a name for the target object and select the source fields that you want to use. Default name is the source object name and by default, all source fields are used. Optionally, enter a file extension for the target object.
The target name can contain alphanumeric characters. You can use only a period (.), an underscore (_), an at the rate sign (@), a dollar sign ($), and a percentage sign (%) special characters in the file name.
You can use parameters defined in a parameter file in the target name.
If you select the advanced source property compression type at run time, the file will be generated with a
.gz
extension. The
.gz
file will contain the data.
Child Object
Not applicable.
After you upgrade from Informatica Cloud Spring 2017 to the
February 2022
release, if you have configured a
synchronization
task using the
Create Target
option with the target specified as the
$param
parameter, and then defined the parameter in the parameter file, the task fails. You must edit the task, recreate the target and then rerun the task.
Do not use the
$LastRunTime
and
$LastRunDate
system parameters in the file name when you create a target. Else, the synchronization task generates an exception.
You can also configure advanced target properties when you schedule the
synchronization
task. Advanced target properties appear on the
Schedule
page of the
Synchronization
Task wizard.
The following table describes the Amazon advanced target properties:
Advanced Target Property
Description
Folder Path
The complete path to the Amazon S3 objects and must include the bucket name and any folder name. Ensure that you do not use a forward slash at the end of the folder path.
For example,
<bucket name>/<my folder name>
The folder path specified at run time overrides the path specified while creating a connection.
Part Size
Specifies the part size of an object.
Default is 5 MB.
TransferManager Thread Pool Size
Specifies the number of the threads to write data in parallel.
Amazon S3 Connector uses the AWS TransferManager API to upload a large object in multiple parts to Amazon S3.
When the file size is more than 5 MB, you can configure multipart upload to upload object in multiple parts in parallel. If you set the value of the
TransferManager Thread Pool Size
to greater than 50, the value reverts to 50.
Default is 10.
Merge Partition Files
Not applicable.
Distribution Column
Specify the name of the column to create multiple target files during run time.
Staging File Location
Amazon S3 staging directory.
When you run a task in Secure Agent runtime environment, specify a directory path that is available on the corresponding Secure Agent machine in the runtime environment.
When you specify the directory path, the Secure Agent create folders depending on the number of partitions that you specify in the following format:
InfaS3Staging<00/11><timestamp>_<partition number>
where, 00 represents read operation and 11 represents write operation.
For example,
InfaS3Staging000703115851268912800_0
The temporary files are created within the new directory.
When you specify a directory name, if a folder with same name already exists, the Secure Agent deletes the contents of the folder. You must have the write permission for the specified location.
If you do not specify a directory path, the Secure Agent uses a temporary directory as the staging file location.
When you run a task in Hosted Agent runtime environment, leave the staging directory location blank. The Hosted Agent creates a directory at a temporary location.
Object Tags
You can add single or multiple tags to the objects stored on the Amazon S3 bucket.
You can either enter the key value pairs or specify the file path that contains the key value pairs. For more information, see Object Tag.
Success File Directory
Not applicable.
Error File Directory
Not applicable.

0 COMMENTS

We’d like to hear from you!