Table of Contents

Search

  1. Preface
  2. Introduction to Big Data Streaming
  3. Big Data Streaming Administration
  4. Sources in a Streaming Mapping
  5. Targets in a Streaming Mapping
  6. Streaming Mappings
  7. Window Transformation
  8. Appendix A: Connections
  9. Appendix B: Sample Files

Advanced Properties

Advanced Properties

The Developer tool displays the advanced properties for Amazon S3 targets in the Input transformation in the
Write
view.
You can configure the following advanced properties for Amazon S3 targets:
Property
Description
Operation Type
Specifies the type of data object operation.
This is a read-only property.
Overwrite File(s) If Exists
Streaming mappings do not support this property.
Folder Path
Bucket name or folder path of the Amazon S3 source file that you want to write to.
If applicable, include the folder name that contains the target file in the
<bucket_name>/<folder_name>
format.
If you do not provide the bucket name and specify the folder path starting with a slash (/) in the
/<folder_name>
format, the folder path appends with the folder path that you specified in the connection properties.
For example, if you specify the
<my_bucket1>/<dir1>
folder path in the connection property and
/<dir2>
folder path in this property, the folder path appends with the folder path that you specified in the connection properties in
<my_bucket1>/<dir1>/<dir2>
format.
If you specify the
<my_bucket1>/<dir1>
folder path in the connection property and
<my_bucket2>/<dir2>
folder path in this property, the Data Integration Service writes the file in the
<my_bucket2>/<dir2>
folder path that you specify in this property.
File Name
Name of the Amazon S3 source file that you want to write to.
Encryption Type
Method you want to use to encrypt data.
Select one of the following values:
  • None
  • Server Side Encryption
Streaming mappings do not support client side encryption and server side encryption with KMS.
Staging Directory
Streaming mappings do not support this property.
File Merge
Streaming mappings do not support this property.
Hadoop Performance Tuning Options
Streaming mappings do not support this property.
Compression Format
Compresses data when you write data to Amazon S3.
You can compress the data in the following formats:
  • None
  • Bzip2
  • Deflate
  • Gzip
  • Lzo
  • Snappy
  • Zlib
Default is None.
Object Tags
Streaming mappings do not support this property.
TransferManager Thread Pool Size
Streaming mappings do not support this property.
Part Size
Streaming mappings do not support this property.