Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange for Microsoft Azure Data Lake Storage Gen2
  3. PowerExchange for Microsoft Azure Data Lake Storage Gen2 Configuration
  4. Microsoft Azure Data Lake Storage Gen2 Connections
  5. PowerExchange for Microsoft Azure Data Lake Storage Gen2 Data Objects
  6. Microsoft Azure Data Lake Storage Gen2 Mappings
  7. Appendix A: Microsoft Azure Data Lake Storage Gen2 Datatype Reference

PowerExchange for Microsoft Azure Data Lake Storage Gen2 User Guide

PowerExchange for Microsoft Azure Data Lake Storage Gen2 User Guide

Rules and Guidelines for Microsoft Azure Data Lake Storage Gen2 Mappings

Rules and Guidelines for Microsoft Azure Data Lake Storage Gen2 Mappings

Consider the following rules and guidelines for Microsoft Azure Data Lake Storage Gen2 mappings:
  • When you run a mapping to read or write complex files on RHEL version 8.2, ensure that you update the third-party libraries to
    wildfly-openssl-java-1.0.10.Final.jar
    in the distribution where you want to run the mapping. Else, the mapping fails.
  • When you run a mapping on the Spark engine or Databricks Spark engine and use the shared key authentication to connect to Microsoft Azure Data Lake Storage Gen2, ensure that you use the same access key for both the source and target connections.
    For example, if you use Key 1 as the access key for the source connection and Key 2 for the target connection, the mapping fails.
  • When you run a mapping to read a flat file, the following behavior is observed for the text qualifier:
    Environment
    Description
    Native
    When you set the Qualifier Mode to Minimal, the qualifier is retained for the columns in the target.
    When you set the Qualifier Mode to All, the qualifier is not retained for the columns in the target.
    Spark Engine
    For both Minimal and All mode, the qualifier is retained for the columns in the target.
    Databricks Spark Engine
    For both Minimal and All mode, the qualifier is not retained for the columns in the target.

0 COMMENTS

We’d like to hear from you!