Table of Contents

Search

  1. Preface
  2. Introduction to Microsoft Azure Data Lake Storage Gen2 Connector
  3. Connections for Microsoft Azure Data Lake Storage Gen2
  4. Mappings for Microsoft Azure Data Lake Storage Gen2
  5. Migrating a mapping
  6. Data type reference
  7. Troubleshooting

Microsoft Azure Data Lake Storage Gen2 Connector

Microsoft Azure Data Lake Storage Gen2 Connector

Directory source in Microsoft Azure Data Lake Storage Gen2 sources

Directory source in
Microsoft Azure Data Lake Storage Gen2
sources

You can select the type of source from which you want to read data.
You can select the following type of sources from the
Source Type
option under the advanced source properties:
  • File
  • Directory
Use the following rules and guidelines to select
Directory
as the source type:
  • All the source files in the directory must contain the same metadata.
  • All the files must have data in the same format. For example, delimiters, header fields, and escape characters must be same.
  • All the files under a specified directory are parsed. To parse the files in the subdirectories, use recursive read.
    For more information, see Reading files from subdirectories.
  • When you run a mapping that reads data from a directory, the agent creates a single file in the target. When you create a mapping in advanced mode, the agent creates multiple files in the target.

0 COMMENTS

We’d like to hear from you!