Amazon S3 Connector Guide

Amazon S3 Connector Guide

Amazon S3 Connector

Amazon S3 Connector

Application Integration
supports several types of listener-based connectors that can be used for event-based processing of messages and files. These connectors expose a wide range of connection attributes you can use to configure a listener-based connection.
You can configure the Amazon Simple Storage Service (S3) Connector as a file monitor that makes data objects, service calls, and events available to the Process Designer.
Using the Amazon S3 Connector, you can work with files that reside in the S3 storage system similar to how you handle local files using the File Connector. For example, you can:
  1. Monitor an S3 bucket for new objects and generate events for processes. You can access S3 object metadata or S3 object content as plain text, binary data, attachment or a set of process objects that are built from parsed XML, JSON, or delimited content.
  2. Write S3 objects to an S3 bucket as delimited content, arbitrary string data, binary data, attachments or list of process objects (represented as XML or JSON).

Amazon S3 Object Store

Amazon S3 is a key-based object store. The unique object key assigned by the user can later be used to retrieve the data. Each object is stored and retrieved using a unique key.
Each account contains one or more buckets to store data and to organize the Amazon S3 namespace. An object is uniquely identified within a bucket by a key (unique identifier) and a version ID.
In this example:
http://mybucket.s3.amazonaws.com/myfiles/photo1.jpg
the bucket is "mybucket" and the key is "myFiles/photo1.jpg"
Each object in S3 has a data and metadata component. The metadata describes the object using name-value pairs and include, for example, the date last modified and other standard HTTP metadata, such as Content-Type. A bucket can also specify the geographical region where Amazon S3 will store it.
For more information on S3, refer to the Amazon product information, such as http://docs.aws.amazon.com/AmazonS3/latest/dev/Welcome.html.