Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange for Microsoft Azure Blob Storage
  3. PowerExchange for Microsoft Azure Blob Storage Configuration
  4. Microsoft Azure Blob Storage Connections
  5. Microsoft Azure Blob Storage Data Objects
  6. Microsoft Azure Blob Storage Mappings
  7. Data Type Reference

PowerExchange for Microsoft Azure Blob Storage User Guide

PowerExchange for Microsoft Azure Blob Storage User Guide

Rules and Guidelines for Using FileName Port

Rules and Guidelines for Using FileName Port

Use the following rules and guidelines when you use the FileName data in the FileName port:
  • Do not use a colon (:) and forward slash (/) character in the file name data of the FileName port of the source or target object to run a mapping.
  • If you connect the FileName port to the target, empty zero KB files are created in the target folder.
  • Do not connect FileName port to a FileName port because the FileName port in the source might contain colon (:) and forward slash (/) characters.
  • In the Native environment, use the Sorter transformation to sort the source port that you want to map to the FileName port of the Target transformation. After you sort the source port, map the port of the Sorter transformation to the FileName port of the Target transformation. The Data Integration Service creates only one file for each value with the same name. If you do not use the Sorter transformation, the Data Integration Service creates multiple files for each value with the same name.
    For example, create a mapping in the Native environment or on the Spark engine to read or write an Avro file using the FileName port.
    The following image shows the sorter transformation mapping:
    This image shows a sample sorter transformation mapping
    If you want to Map the following source port name to the FileName port of the Target transformation and write the data to an Avro target file
    target1
    :
    Name
    ID
    SSN
    Anna
    1
    1
    John
    4
    4
    Smith
    4
    4
    John
    5
    5
    Anna
    2
    2
    Add a Sorter transformation to sort the source port and map the source port to the port of the Sorter transformation. Then, map the port of the Sorter transformation to the FileName port of the Target transformation. The Data Integration Service creates the following directories and single file per thread within the directories:
    target1.avro=Anna
    In this directory, the Data Integration Service creates a file with the following values:
    1,1,1,2,2,2
    .
    target1.avro=John
    In this directory, the Data Integration Service creates a file with the following values:
    4,4,4,5,5,5
    .
    target1.avro=Smith
    In this directory, the Data Integration Service creates a file with the following values:
    4,4,4
    .
    If you do not add a Sorter transformation, the Data Integration Service creates the following directories and multiple files within the directories:
    target1.avro=Anna
    In this directory, the Data Integration Service creates two part files with the following values:
    1,1,1
    and
    2,2,2
    .
    target1.avro=John
    In this directory, the Data Integration Service creates two files with the following values:
    4,4,4
    and
    5,5,5
    .
    target1.avro=Smith
    In this directory, the Data Integration Service creates one file with the following values:
    4,4,4
    .

0 COMMENTS

We’d like to hear from you!