EDS includes two built-in source services to read from file sources.
When you read from file sources, you can use one of the following built-in source service types:
- File Source Service Type
- Use a File source service to read data from a directory that contains a source file or files that might change.
You can specify the file name or the Java regular expression pattern that applies to the convention used to name the source file. The File source reads the source file as it is being written and monitors the directory for new files matching the regular expression pattern.
- Static File Source Service Type
- Use a Static File source service to read data from a directory that contains a source file or files that do not change. When multiple files are processed in parallel, data from different files is interleaved.
When you configure the Static File source service properties, you can specify the file name or the Java regular expression pattern that applies to the convention used to name the source file. You can also configure the number of threads that are required to process the files and the waiting time. The waiting time is the amount of time to the Static File source service waits before reading data from the active file.
- EDS creates a position file that tracks where the data has been read until. By default, EDS saves the position file in the directory that contains the source file or files. You can also specify a different directory when you configure the properties for the source service.