Microsoft Azure Blob Storage V3 Connector

Microsoft Azure Blob Storage V3 Connector

File formatting options

File formatting options

When you select the format of a Microsoft Azure Blob Storage file, you can configure the formatting options.
The following table describes the formatting options for Avro, Parquet, JSON, and delimited flat files:
Property
Description
Schema Source
The schema of the source or target file.
Select one of the following options to specify a schema:
  • Read from data file. Imports the schema from the file in Microsoft Azure Blob Storage.
  • Import from schema file. Imports schema from a schema definition file in your local machine.
Schema File
The schema definition file in the agent machine from where you want to upload the schema.
You cannot upload a schema file when you select the Create Target option.
The following table describes the formatting options for flat files:
Property
Description
Flat File Type
The type of flat file.
Select one of the following options:
  • Delimited. Reads a flat file that contains column delimiters.
  • Fixed Width. Not applicable.
Delimiter
Character used to separate columns of data. You can set values as comma, tab, colon, semicolon, or others.
You can't set a tab as a delimiter directly in the
Delimiter
field. To set a tab as a delimiter, you must type the tab character in any text editor. Then, copy the character to the
Delimiter
field.
EscapeChar
Character immediately preceding a column delimiter character embedded in an unquoted string, or immediately preceding the quote character in a quoted string.
Qualifier
Quote character that defines the boundaries of text strings. You can configure parameters such as single quote or double quote.
You can use the output text qualifier when a delimiter value is present in the data.
Qualifier Mode
Specify the qualifier behavior for the target object.
You can select one of the following options:
  • Minimal. Default mode. Applies qualifier to data enclosed within a delimiter value or a special character.
  • All. Applies qualifier to all data.
Code Page
Select the code page that the Secure Agent must use to read or write data.
Microsoft Azure Blob Storage V3 Connector supports only UTF-8. Ignore rest of the code pages.
Header Line Number
Specify the line number that you want to use as the header when you read data from Microsoft Azure Blob Storage. You can also read a data from a file that does not have a header. To read data from a file with no header, specify the value of the
Header Line Number
field as 0.
First Data Row
Specify the line number from where you want to start reading the data. Enter a value greater than or equal to one.
To read data from the header, the value of the
Header Line Number
and the
First Data Row
fields should be the same. Default is 1.
Target Header
Select whether you want to write data to a target that contains a header or without a header in the flat file. You can select With Header or Without Header options.
This property is not applicable when you read data from a Microsoft Azure Blob Storage V3 source.
Distribution Column
Not applicable.
escapeCharacterDataRetained
Not applicable.
maxRowsToPreview
Not applicable.
rowDelimiter
Not applicable.
The following table describes the formatting options for JSON files:
Property
Description
Data elements to sample
Not applicable.
Memory available to process data
Not applicable.

0 COMMENTS

We’d like to hear from you!