Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Edge Data Streaming
  3. Licenses
  4. Using Informatica Administrator
  5. Creating and Managing the Edge Data Streaming Service
  6. Edge Data Streaming Entity Types
  7. Edge Data Streaming Nodes
  8. Data Connections
  9. Working With Data Flows
  10. Managing the Edge Data Streaming Components
  11. Security
  12. High Availability
  13. Disaster Recovery
  14. Monitoring Edge Data Streaming Entities
  15. Troubleshooting
  16. Frequently Asked Questions
  17. Regular Expressions
  18. Command Line Program
  19. Configuring Edge Data Streaming to Work With a ZooKeeper Observer
  20. Glossary

User Guide

User Guide

File Source Service Types

EDS includes two built-in source services to read from file sources.
When you read from file sources, you can use one of the following built-in source service types:
File Source Service Type
Use a File source service to read data from a directory that contains a source file or files that might change.
You can specify the file name or the Java regular expression pattern that applies to the convention used to name the source file. The File source reads the source file as it is being written and monitors the directory for new files matching the regular expression pattern.
Static File Source Service Type
Use a Static File source service to read data from a directory that contains a source file or files that do not change. When multiple files are processed in parallel, data from different files is interleaved.
When you configure the Static File source service properties, you can specify the file name or the Java regular expression pattern that applies to the convention used to name the source file. You can also configure the number of threads that are required to process the files and the waiting time. The waiting time is the amount of time to the Static File source service waits before reading data from the active file.
EDS creates a position file that tracks where the data has been read until. By default, EDS saves the position file in the directory that contains the source file or files. You can also specify a different directory when you configure the properties for the source service.
For more information about Java regular expressions, see the Java regular expression documentation.


Updated March 19, 2019


Explore Informatica Network