Microsoft Azure Blob Storage V3 Connector

Microsoft Azure Blob Storage V3 Connector

Directory source in Microsoft Azure Blob Storage sources

Directory source in Microsoft Azure Blob Storage sources

You can select the type of source from which you want to read data.
You can select the following type of sources from the
Source Type
option under the advanced source properties:
  • File
  • Directory
Use the following rules and guidelines to select
Directory
as the source type:
  • All the source files in the directory must contain the same metadata.
  • All the files must have data in the same format. For example, delimiters, header fields, and escape characters must be same.
  • All the files under a specified directory are parsed. The files under subdirectories are not parsed.
  • The connector does not perform any validation if there are multiple blob formats in the directory you select and might result into errors.

0 COMMENTS

We’d like to hear from you!
Erick Maps - March 14, 2023

Hi,

 

I want to be able to parse through different subdirectories as my azure v3 storage dataset is setup in date subdirectories.

I want to read all the json files for each date within a blob.

How do I do that?

I am OK to pass that as a string.

It is like blobname/othername/root/date_folder/file1.json

 

Informatica Documentation Team - March 15, 2023

Hi Erick Maps,

You cannot use Microsoft Azure Blob Storage V3 Connector to recursively read from multiple sub-directories.

If you have the license for Microsoft Azure Data Lake Storage Gen2 Connector, you can use it for recursive read.

Thanks,

Informatica Documentation Team