Table of Contents

Search

  1. Preface
  2. Understanding Pipeline Partitioning
  3. Partition Points
  4. Partition Types
  5. Pushdown Optimization
  6. Pushdown Optimization and Transformations
  7. Real-time Processing
  8. Commit Points
  9. Row Error Logging
  10. Workflow Recovery
  11. Stopping and Aborting
  12. Concurrent Workflows
  13. Grid Processing
  14. Load Balancer
  15. Workflow Variables
  16. Parameters and Variables in Sessions
  17. Parameter Files
  18. FastExport
  19. External Loading
  20. FTP
  21. Session Caches
  22. Incremental Aggregation
  23. Session Log Interface
  24. Understanding Buffer Memory
  25. High Precision Data

Advanced Workflow Guide

Advanced Workflow Guide

Using FTP with Source Files

Using FTP with Source Files

Use FTP in a session that reads flat file or XML file sources. You can stage the source files for a session on the machine hosting the Integration Service. Use a single source file or a file list for each source instance.
When you stage source data, the Integration Service uses FTP to create a local file. It uses the local file as the source for the session. The Integration Service does not move data into the pipeline until the staged file is complete.
If you do not stage the source data, the Integration Service uses FTP to access the source file directly. If the network fails, you must run the session again.
The following table describes the behavior of the Integration Service using FTP with source files:
Source Type
Is Staged
Integration Service Behavior
Direct
Yes
Integration Service copies the file from the FTP host to the machine hosting the Integration Service after the session begins.
Direct
No
Integration Service uses FTP to access the source file directly.
Indirect
Yes
Integration Service reads the file list and copies the file list and the source files to the machine hosting the Integration Service after the session begins.
Indirect
No
Integration Service copies the file list to the machine hosting the Integration Service after the session begins. The Integration Service uses FTP to access the source files directly.


Updated June 03, 2019