Table of Contents

Search

Creating an Amazon S3 Data Operations

Creating an Amazon S3 Data Operations

Create an Amazon S3 data object to add to a mapping.
PowerExchange for Amazon S3 supports only UTF-8 encoding to read or write data.
  1. Select a project or folder in the
    Object Explorer
    view.
  2. Click
    File
    New
    Data Object
    .
  3. Select
    Amazon S3 Data Object
    and click
    Next
    .
    The
    Amazon S3 Data Object
    dialog box appears.
  4. Enter a name for the data object.
  5. In the Resource Format list, select any of the following formats:
    • Binary: to read any resource format.
    • Flat: to read a flat resource.
    • Avro: to read an Avro resource.
    • Parquet: to read a Parquet resource.
  6. Click
    Browse
    next to the
    Location
    option and select the target project or folder.
  7. Click
    Browse
    next to the
    Connection
    option and select the Amazon S3 connection from which you want to import the Amazon S3 object.
  8. To add a resource, click
    Add
    next to the
    Selected Resources
    option.
    The
    Add Resource
    dialog box appears.
  9. Select the check box next to the Amazon S3 object you want to add and click
    OK
    .
  10. Click
    Next
    .
  11. Choose
    Sample Metadata File
    .
    You can click
    Browse
    and navigate to the directory that contains the file.
    The
    Delimited
    and
    Fixed-width
    format properties are not applicable for PowerExchange for Amazon S3.
  12. Click
    Next
    .
  13. Configure the format properties.
    Property
    Description
    Delimiters
    Character used to separate columns of data. If you enter a delimiter that is the same as the escape character or the text qualifier, you might receive unexpected results. Amazon S3 reader and writer support Delimiters.
    Text Qualifier
    Quote character that defines the boundaries of text strings. If you select a quote character, the Developer tool ignores delimiters within pairs of quotes. Amazon S3 reader supports Text Qualifier.
    Import Column Names From First Line
    If selected, the Developer tool uses data in the first row for column names. Select this option if column names appear in the first row. The Developer tool prefixes"FIELD_" to field names that are not valid. Amazon S3 reader and writer support Import Column Names From First Line.
    Row Delimiter
    Specify a line break character. Select from the list or enter a character. Preface an octal code with a backslash (\).
    To use a single character, enter the character. The Data Integration Service uses only the first character when the entry is not preceded by a backslash. The character must be a single-byte character, and no other character in the code page can contain that byte.
    Default is line-feed, \012 LF (\n).
    Escape Character
    Character immediately preceding a column delimiter character embedded in an unquoted string, or immediately preceding the quote character in a quoted string.
    When you specify an escape character, the Data Integration Service reads the delimiter character as a regular character.
    The
    Start import at line
    ,
    Treat consecutive delimters as one
    , and
    Retain escape character in data
    properties in the
    Column Projection
    dialog box are not applicable for PowerExchange for Amazon S3.
  14. Click
    Next
    to preview the flat file data object.
  15. Click
    Finish
    .
    The data object appears under the Physical Data Objects category in the project or folder in the
    Object Explorer
    view. A read and write operation is created for the data object. Depending on whether you want to use the Amazon S3 data object as a source or target, you can edit the read or write operation properties.


Updated July 30, 2020