Microsoft Azure Blob Storage V3 Connector

Microsoft Azure Blob Storage V3 Connector

Microsoft Azure Blob Storage V3 sources in mappings

Microsoft Azure Blob Storage V3 sources in mappings

In a mapping, you can configure a Source transformation to represent a Microsoft Azure Blob Storage V3 object.
The following table describes the Microsoft Azure Blob Storage V3 source properties that you can configure in a Source transformation:
Property
Description
Connection
Name of the source connection. Select a source connection or click
New Parameter
to define a new parameter for the source connection.
Source Type
Source type. Select one of the following types:
  • Single Object
  • Parameter: Select Parameter to define the source type when you configure the mapping task.
Object
Name of the source object.
You can drill-down and select an object from a sub-folder to fetch metadata from a particular object. When you run a task, the Secure Agent reads data from the container you specified either in connection properties or in the advance properties.
Parameter
Select an existing parameter for the source object or click
New Parameter
to define a new parameter for the source object.
The
Parameter
property appears only if you select Parameter as the source type.
Format
Specifies the file format that the Microsoft Azure Blob Storage V3 Connector uses to read data from Microsoft Azure Blob Storage.
You can select the following file format types:
  • Flat
  • Avro
  • Parquet
  • JSON
Default is
None
.
You must select the
Format Type
as
None
to read binary files.
For more information, see File formatting options.
The following table describes the Microsoft Azure Blob Storage V3 advanced source properties that you can configure in a Source transformation:
Property
Description
Number of concurrent connections to Blob Store
The number of concurrent connections to Blob Store to upload files. Default is 4.
Source Type
Select the type of source from which you want to read data. You can select the following source types:
  • File
  • Directory
Default is File.
Blob Name Override
Overrides the default file name.
Blob Container Override
Overrides the default container name.
When you read data from a directory and override the Blob container, ensure that files in the Blob container that you override with are not empty.
When you generate the SAS token at the container-level, the default container name and the container name that you specify for the container override must be the same.
Compression Format
Decompresses data when you read data from Microsoft Azure Blob Storage. You can decompress the data in the following formats:
  • None. Select None to decompress deflate and snappy file formats.
  • Gzip
  • Bzip2
  • Lzo
Default is None.
Tracing Level
Sets the amount of detail that appears in the log file.
You can choose terse, normal, verbose initialization, or verbose data.
Default is normal.

0 COMMENTS

We’d like to hear from you!
Erick Maps - March 14, 2023

I get this error when I try to read from v3 azure blob json file:

Cannot create read operation. All fields support write operation only

If I switch to string, it doesn't show

Informatica Documentation Team - March 15, 2023

Hi Eric Maps, 

If you are reading from a JSON file, ensure that you are using a single-line JSON file. You cannot read and write nested and multi-line indented JSON files. See the support statement covered in the following topic: Microsoft Azure Blob Storage V3 Connector
If you still face issues, you can contact Informatica Global Customer Support.

Thanks, 
Informatica Documentation Team