Migrating a connector from previous versions using the Data Integration REST API

Migrating a connector from previous versions using the Data Integration REST API

Guidelines to migrate to Microsoft Azure Blob Storage V3

Guidelines to migrate to Microsoft Azure Blob Storage V3

Some guidelines and restrictions apply to assets when you migrate the Microsoft Azure Blob Storage V1 and V2 connections to Microsoft Azure Blob Storage V3.

Guidelines applicable to Microsoft Azure Blob Storage V1 connection

The following guidelines are applicable when you migrate the Microsoft Azure Blob Storage V1 connection to Microsoft Azure Blob Storage V3.
Source transformation
Consider the following migration guidelines when you configure a read operation:
  • After the migration, when you run a mapping to read data that contains double quotes ("), the double quotes is treated as a qualifier resulting in data mismatch in the target.
  • After the migration, when you run a mapping to read data where a column name contains a single quote ('), the agent replaces the single quote in the metadata with an underscore (_) character resulting in failure.
  • When you read data that contains special characters and create a target at runtime, data corruption occurs and the mapping fails. After the migration, data corruption does not occur and the same mapping runs successfully.
  • When you read a compressed file either in the source object or in the overridden object, ensure that the file name has a .gz extension.
  • The
    Header in the first row of Blob
    option in the source in a Microsoft Azure Blob Storage V1 mapping after the migration is mapped to the
    Header Line
    and
    First Data Row
    options in the Microsoft Azure Blob Storage V3 mapping.
    If the
    Header in the first row of Blob
    option is enabled in a Microsoft Azure Blob Storage V1 mapping, after migration, the value
    Header Line
    is set to 1 and
    First Data Row
    is set to 2.
    If the
    Header in the first row of Blob
    option is not enabled in a Microsoft Azure Blob Storage V1 mapping, after migration, the value
    Header Line
    is set to 0 and
    First Data Row
    is set to 1.
Target Transformation
Consider the following migration guidelines when you configure a write operation:
  • After the migration, when you configure a Target transformation, the Success File Directory and Error File Directory target properties are not available in Microsoft Azure Blob Storage V3.
  • The
    Header in the first row of Blob
    option in the target in a Microsoft Azure Blob Storage V1 mapping after the migration is mapped to the
    Target Header
    option in the Microsoft Azure Blob Storage V3 mapping.
    If the
    Header in the first row of Blob
    option is enabled in a Microsoft Azure Blob Storage V1 mapping, after migration, the mapping writes the data with the header to the target.
    If the
    Header in the first row of Blob
    option is not enabled in a Microsoft Azure Blob Storage V1 mapping, after migration, the mapping writes the data without the header to the target.
Connection
Before the migration, ensure that the container name in Microsoft Azure Blob Storage V1 and V3 connections is the same.

Guidelines applicable to Microsoft Azure Blob Storage V2 connection

The following guidelines are applicable when you migrate the Microsoft Azure Blob Storage V2 connection to Microsoft Azure Blob Storage V3.
Source transformation
Consider the following migration guidelines when you configure a read operation:
  • If the override value for the blob container name in the Microsoft Azure Blob Storage V2 mapping ends with a forward slash (/), the mapping fails after the migration.
    Before the migration, ensure that the override value for the blob container name does not end with forward slash (/).
  • The
    Header in the first row of Blob
    option in the source in a Microsoft Azure Blob Storage V2 mapping after the migration is mapped to the
    Header Line
    and
    First Data Row
    options in the Microsoft Azure Blob Storage V3 mapping.
    If the
    Header in the first row of Blob
    option is enabled in a Microsoft Azure Blob Storage V2 mapping, after migration, the value
    Header Line
    is set to 1 and
    First Data Row
    is set to 2.
    If the
    Header in the first row of Blob
    option is not enabled in a Microsoft Azure Blob Storage V2 mapping, after migration, the value
    Header Line
    is set to 0 and
    First Data Row
    is set to 1.
Target transformation
Consider the following migration guidelines when you configure a write operation:
  • If the override value for the blob container name in the Microsoft Azure Blob Storage V2 mapping ends with a forward slash (/), the mapping replaces the blob container with an unnamed folder in the target.
    After the migration, the same mapping replaces the blob container with the root directory in the target.
  • The
    Header in the first row of Blob
    option in the target in a Microsoft Azure Blob Storage V2 mapping after the migration is mapped to the
    Target Header
    option in the Microsoft Azure Blob Storage V3 mapping.
    If the
    Header in the first row of Blob
    option is enabled in a Microsoft Azure Blob Storage V2 mapping, after migration, the mapping writes the data with the header to the target.
    If the
    Header in the first row of Blob
    option is not enabled in a Microsoft Azure Blob Storage V2 mapping, after migration, the mapping writes the data without the header to the target.
Compression
When you enable compression in a Microsoft Azure Blob Storage V2 mapping, the data is not compressed. After the migration, the same mapping uses Gzip compression to compress the data.

Guidelines applicable to Microsoft Azure Blob Storage V1 and V2 connections

The following guidelines are applicable when you migrate the Microsoft Azure Blob Storage V1 and V2 connections to Microsoft Azure Blob Storage V3.
Parameterization
Consider the following migration guidelines for parameterized Microsoft Azure Blob Storage mappings:
  • If you create a completely parameterized mapping, do not specify the connection type in the connection parameterization. If you specify the connection type in the connection parameterization and then migrate the mapping, the mapping fails at runtime.
  • When you parameterize both the connection and the objects in a Microsoft Azure Blob Storage V1 and V2 mapping, the data preview in the mapping task might fail after the migration with the following error:
    Internal error while processing request. Please contact Informatica Global Customer Support.
    To avoid this error, reselect the object in the mapping to preview the data.

0 COMMENTS

We’d like to hear from you!