Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Edge Data Streaming
  3. Licenses
  4. Using Informatica Administrator
  5. Creating and Managing the Edge Data Streaming Service
  6. Edge Data Streaming Entity Types
  7. Edge Data Streaming Nodes
  8. Data Connections
  9. Working With Data Flows
  10. Managing the Edge Data Streaming Components
  11. Security
  12. High Availability
  13. Disaster Recovery
  14. Monitoring Edge Data Streaming Entities
  15. Appendix A: Troubleshooting
  16. Appendix B: Frequently Asked Questions
  17. Appendix C: Regular Expressions
  18. Appendix D: Command Line Program
  19. Appendix E: Configuring Edge Data Streaming to Work With a ZooKeeper Observer
  20. Appendix F: Glossary

User Guide

User Guide

Amazon S3 Target Service Properties

Amazon S3 Target Service Properties

To add Amazon S3 target service, use Amazon S3 target service type.
You can configure the following properties for Amazon S3 target service type:
Entity Name
Name of the Amazon S3 target service. Maximum length is 32 characters.
Description
Description of the Amazon S3 target service. Maximum length is 256 characters.
Destination Mode
Destination to which you want to write the data. Default is Amazon S3.
AWS Access Key Id
Access key ID to access the Amazon S3 resources.
AWS Secret Access Key
Secret access key to access the Amazon S3 resources.
AWS Credential Profile Name
An AWS credential profile name defined in the credentials file. A data flow accesses the AWS credentials through the profile name at run time.
If you do not provide an AWS credential profile name, the data flow uses the access key ID and secret access key that you specify.
If you provide an AWS credential profile name along with access key ID and secret access key, the data flow uses the access key ID and secret access key.
S3 Bucket Name
Name of the Amazon S3 bucket to write the data.
S3 Key
A unique key that identifies an Amazon S3 object in an Amazon S3 bucket to which you want to write data.
Rollover Size (MB)
Target file size, in megabytes (MB), at which to trigger rollover. Default is 10 MB. Maximum rollover size is 2047 MB.
Advanced Properties
Specify properties for Amazon S3 target service. Edge Data Streaming 2.5.0 supports S3A scheme.
Edge Data Streaming 2.5.0 does not support the following properties:
  • fs.s3a.multipart.size
  • fs.s3a.access.key
  • fs.s3a.secret.key
  • fs.s3a.buffer.key
  • fs.s3a.fast.upload.buffer
Statistics
Detailed statistics of the mapping that writes data to an Amazon S3 target.
You can choose to monitor the following statistics for Amazon S3 target service:
  • Byte Received. The number of bytes the target service receives.
  • Events Received. The number of events the target service receives.
  • Receive Rate (Per Sec). The number of bytes the target service receives every second.
  • Events Reassigned. The number of messages that the source resends to the target service when it does not receive acknowledgment from the target service.
  • Files Rolled Over. The number of files rolled over.
Retry on Failure
,
Receive Idle Events
, and
Number of Retries
properties are not applicable for Amazon S3 target service.

0 COMMENTS

We’d like to hear from you!