Table of Contents

Search

  1. Preface
  2. Introduction to Data Engineering Streaming
  3. Data Engineering Streaming Administration
  4. Sources in a Streaming Mapping
  5. Targets in a Streaming Mapping
  6. Streaming Mappings
  7. Window Transformation
  8. Appendix A: Connections
  9. Appendix B: Monitoring REST API Reference
  10. Appendix C: Sample Files

Advanced Properties

Advanced Properties

The Developer tool displays the advanced properties for Amazon S3 targets in the Input transformation in the
Write
view.
You can configure the following advanced properties for Amazon S3 targets:
Property
Description
Operation Type
Specifies the type of data object operation.
This is a read-only property.
Overwrite File(s) If Exists
Not applicable for streaming mappings.
Folder Path
Bucket name or folder path of the Amazon S3 source file that you want to write to.
If applicable, include the folder name that contains the target file in the
<bucket_name>/<folder_name>
format.
If you do not provide the bucket name and specify the folder path starting with a slash (/) in the
/<folder_name>
format, the folder path appends with the folder path that you specified in the connection properties.
For example, if you specify the
<my_bucket1>/<dir1>
folder path in the connection property and
/<dir2>
folder path in this property, the folder path appends with the folder path that you specified in the connection properties in
<my_bucket1>/<dir1>/<dir2>
format.
If you specify the
<my_bucket1>/<dir1>
folder path in the connection property and
<my_bucket2>/<dir2>
folder path in this property, the Data Integration Service writes the file in the
<my_bucket2>/<dir2>
folder path that you specify in this property.
File Name
Name of the Amazon S3 target file that you want to write to. The file specified at run time overrides the file specified while creating a connection.
Encryption Type
Method you want to use to encrypt data.
Select one of the following values:
  • None
  • Server Side Encryption
Client side encryption and server side encryption with KMS are not applicable for streaming mappings.
Staging Directory
Not applicable for streaming mappings.
File Merge
Not applicable for streaming mappings.
Hadoop Performance Tuning Options
Not applicable for streaming mappings.
Compression Format
Compresses data when you write data to Amazon S3.
You can compress the data in the following formats:
  • None
  • Bzip2
  • Deflate
  • Gzip
  • Lzo
  • Snappy
  • Zlib
Default is None.
Object Tags
Not applicable for streaming mappings.
TransferManager Thread Pool Size
Not applicable for streaming mappings.
Part Size
Not applicable for streaming mappings.