Communities
A collaborative platform to connect and grow with like-minded Informaticans across the globe
Product Communities
Connect and collaborate with Informatica experts and champions
Discussions
Have a question? Start a Discussion and get immediate answers you are looking for
User Groups
Customer-organized groups that meet online and in-person. Join today to network, share ideas, and get tips on how to get the most out of Informatica
Get Started
Community Guidelines
Knowledge Center
Troubleshooting documents, product guides, how to videos, best practices, and more
Knowledge Base
One-stop self-service portal for solutions, FAQs, Whitepapers, How Tos, Videos, and more
Support TV
Video channel for step-by-step instructions to use our products, best practices, troubleshooting tips, and much more
Documentation
Information library of the latest product documents
Velocity (Best Practices)
Best practices and use cases from the Implementation team
Learn
Rich resources to help you leverage full capabilities of our products
Trainings
Role-based training programs for the best ROI
Certifications
Get certified on Informatica products. Free, Foundation, or Professional
Product Learning Paths
Free and unlimited modules based on your expertise level and journey
Resources
Library of content to help you leverage the best of Informatica products
Tech Tuesdays Webinars
Most popular webinars on product architecture, best practices, and more
Product Availability Matrix
Product Availability Matrix statements of Informatica products
SupportFlash
Monthly support newsletter
Support Documents
Informatica Support Guide and Statements, Quick Start Guides, and Cloud Product Description Schedule
Product Lifecycle
End of Life statements of Informatica products
Ideas
Events
Change Request Tracking
Marketplace
English
  • Data Integration Connectors
  • All Products

Table of Contents

Search

  1. Preface
  2. Introduction to Amazon Connector
  3. Amazon S3 Connections
  4. Amazon S3 Sources and Targets
  5. Synchronization Tasks with Amazon S3
  6. Mappings and Mapping Tasks with Amazon S3
  7. Appendix A: Data Type Reference
  8. Appendix B: Troubleshooting

Amazon S3 Connector

Amazon S3 Connector

Back Next

Partitioning

Partitioning

You can configure partitioning to optimize the mapping performance at run time when you read data from Amazon S3 sources.
The partition type controls how the agent distributes data among partitions at partition points. You can define the partition type as passthrough partitioning. With partitioning, the Secure Agent distributes rows of source data based on the number of threads that you define as partition.
You can specify the value of the
Number of Partition
 field in the
Partition
 tab under the mapping task to configure partitioning for Amazon S3 sources. The Secure Agent configures the partition for Amazon S3 sources based on the value you enter in the
Number of Partition
 field. By default, the value of the
Number of Partition
 field is one.
The Secure Agent enables the partition according to the size of the Amazon S3 source file. The file name is appended with a number starting from 0 in the following format:
<file name>_<number>
If you enable partitioning and the precision for the source column is less than the maximum data length in that column, you might receive unexpected results. To avoid unexpected results, the precision for the source column must be equal to or greater than the maximum data length in that column for partitioning to work as expected.
You cannot configure partitioning for mappings that read data from multiple Amazon S3 sources.
0 COMMENTS
We’d like to hear from you!