Table of Contents

Search

  1. Preface
  2. Performance Tuning Overview
  3. Target Optimization
  4. Source Optimization
  5. Transformation Optimization
  6. Mapping Optimization
  7. Partitioned Mapping Optimization
  8. Run-time Optimization
  9. SQL Data Service Optimization
  10. Web Service Optimization
  11. Connections Optimization
  12. Data Transformation Optimization

Performance Tuning Guide

Performance Tuning Guide

Optimize Flat File Sources for Partitioning

Optimize Flat File Sources for Partitioning

To achieve optimal performance when using multiple threads to read from a flat file, configure the flat file data object to optimize throughput instead of preserving row order.
Consider the following solution to reduce bottlenecks for partitioned flat file sources:
Configure concurrent read partitioning for the flat file data object to optimize throughput.
In the flat file data object advanced properties, set the
Concurrent Read Partitioning
property to optimize throughput. When you optimize throughput, the Data Integration Service does not preserve row order because it does not read the rows in the file or file list sequentially.

0 COMMENTS

We’d like to hear from you!