Microsoft Azure Blob Storage V3 Connector

Back Next

Directory source in Microsoft Azure Blob Storage sources

You can select the type of source from which you want to read data.

You can select the following type of sources from the

Source Type

option under the advanced source properties:

File

Directory

as the source type:

All the source files in the directory must contain the same metadata.

All the files must have data in the same format. For example, delimiters, header fields, and escape characters must be same.

All the files under a specified directory are parsed. The files under subdirectories are not parsed.

The connector does not perform any validation if there are multiple blob formats in the directory you select and might result into errors.

Watch

Comments

0 COMMENTS

We’d like to hear from you! Log in to comment.

Erick Maps - March 14, 2023

Hi,

I want to be able to parse through different subdirectories as my azure v3 storage dataset is setup in date subdirectories.

I want to read all the json files for each date within a blob.

How do I do that?

I am OK to pass that as a string.

It is like blobname/othername/root/date_folder/file1.json

Informatica Documentation Team - March 15, 2023

Hi Erick Maps,

You cannot use Microsoft Azure Blob Storage V3 Connector to recursively read from multiple sub-directories.

If you have the license for Microsoft Azure Data Lake Storage Gen2 Connector, you can use it for recursive read.

Thanks,

Informatica Documentation Team