Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange for Microsoft Azure Data Lake Storage Gen2
  3. PowerExchange for Microsoft Azure Data Lake Storage Gen2 Configuration
  4. Microsoft Azure Data Lake Storage Gen2 Connections
  5. PowerExchange for Microsoft Azure Data Lake Storage Gen2 Data Objects
  6. Microsoft Azure Data Lake Storage Gen2 Mappings
  7. Appendix A: Microsoft Azure Data Lake Storage Gen2 Datatype Reference

PowerExchange for Microsoft Azure Data Lake Storage Gen2 User Guide

PowerExchange for Microsoft Azure Data Lake Storage Gen2 User Guide

ORC Data Types and Transformation Data Types

ORC Data Types and Transformation Data Types

ORC file data types map to transformation data types that the Data Integration Service uses to move data across platforms.
The following table lists the ORC file data types that the Data Integration Service supports and the corresponding transformation data types:
ORC File Data Type
Transformation Data Type
Range and Description
BigInt
BigInt
-9223372036854775808 to 9,223,372,036,854,775,807.
Boolean
Integer
TRUE (1) or FALSE (0).
Char
String
1 to 104,857,600 characters.
Date
Date/Time
January 1, 0001 to December 31, 9999.
Double
Double
Precision of 15 digits.
Float
Double
Precision of 15 digits.
Integer
Integer
-2,147,483,648 to 2,147,483,647.
SmallInt
Integer
-32,768 to 32,767.
String
String
1 to 104,857,600 characters.
Timestamp
Date/Time
January 1, 0001 00:00:00 to December 31, 9999 23:59:59.997.
Precision to microsecond.
TinyInt
Integer
-128 to 127.
Varchar
String
1 to 104,857,600 characters.
When you run a mapping on the Spark or Databricks Spark engine to write an ORC file to a target, the Data Integration Service writes the data of the Char and Varchar data types as String.
You can use ORC data types to read and write complex file objects in mappings that run on the Spark engine only.

Unsupported ORC Data Types

The Developer tool does not support the following ORC data types:
  • Map
  • List
  • Struct
  • Union

0 COMMENTS

We’d like to hear from you!