Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange for Microsoft Azure Blob Storage
  3. PowerExchange for Microsoft Azure Blob Storage Configuration
  4. Microsoft Azure Blob Storage Connections
  5. Microsoft Azure Blob Storage Data Objects
  6. Microsoft Azure Blob Storage Mappings
  7. Data Type Reference

PowerExchange for Microsoft Azure Blob Storage User Guide

PowerExchange for Microsoft Azure Blob Storage User Guide

Creating a Microsoft Azure Blob Storage Data Object

Creating a Microsoft Azure Blob Storage Data Object

Create a Microsoft Azure Blob Storage data object to add to a mapping.
  1. Select a project or folder in the
    Object Explorer
    view.
  2. Click
    File
    New
    Data Object
    .
  3. Select
    Azure Blob Storage Data Object
    and click
    Next
    .
    The Azure Blob Storage Data Object dialog box appears.
  4. Enter a name for the data object.
  5. In the
    Resource Format
    list, select any of the following formats:
    • Intelligent Structure Model: to read any format that an intelligent structure parses.
    • Binary: to read any resource format.
    • Flat: to read and write delimited resources.
    • Avro: to read and write Avro resources.
    • Json: to read and write JSON resources.
    • Parquet: to read and write Parquet resources.
    Intelligent structure model is supported only on the Spark engine. JSON is supported in the non-native environments. Avro and Parquet are supported in the native and non-native environments.
  6. Click
    Browse
    next to the
    Location
    option and select the target project or folder.
  7. Click
    Browse
    next to the
    Connection
    option and select the AzureBlob connection from which you want to import the Microsoft Azure Blob Storage object.
  8. To add a resource, click
    Add
    next to the
    Selected Resources
    option.
    The Add Resource dialog box appears.
  9. Navigate through the container structure and select the checkbox next to the Microsoft Azure Blob Storage object you want to add and click
    OK
    .
    You must select the object according to the selected resource format. To use an intelligent structure model, select the appropriate
    .amodel
    file.
  10. Click
    Finish
    if you selected Intelligent Structure Model, Avro, Json, or Parquet file and skip the remaining steps. Click
    Next
    if you selected a flat file.
  11. Applicable only to the delimited files. Choose
    Sample Metadata File
    .
    You can click Browse and navigate to the directory that contains the file.
  12. Click
    Next
    .
  13. Configure the format properties.
    Property
    Description
    Delimiters
    Character used to separate columns of data. Make sure that the delimiter you select is not a part of the data. If you enter a delimiter that is the same as the escape character or the text qualifier, you might receive unexpected results. Microsoft Azure Blob Storage reader and writer support Delimiters.
    Text Qualifier
    Quote character that defines the boundaries of text strings. Make sure that the text qualifier you select is not a part of the data unless it is escaped. If you select a quote character, the Developer tool ignores delimiters within pairs of quotes. Microsoft Azure Blob Storage reader supports Text Qualifier.
    Import Column Names From First Line
    If selected, the Developer tool uses data in the first row for column names. Select this option if column names appear in the first row. Do not select this option to read header-less files. Applicable only to the native environment.
  14. Click
    Next
    to configure the column properties and edit the column attributes.
  15. Click
    Finish
    .
    The data object appears under Data Objects in the project or folder in the Object Explorer view. The data object read and write operations are created by default when a data object is created.
    When you create a Microsoft Azure Blob Storage data object, the value of the folder path is displayed incorrectly in the
    Resources
    tab.