Hadoop Files V2 Connector

Back Next

Parquet complex file data types and transformation data types

Parquet complex file data types map to transformation data types that the Secure Agent uses to move data across platforms.

The following table lists the Parquet complex file data types that the Secure Agent supports and the corresponding transformation data types:

Parquet Complex File Data Type	Transformation Data Type	Range and Description
Binary	Binary	1 to 104,857,600 bytes.
Boolean	Integer	TRUE (1) or FALSE (0).
Date	Date/Time	January 1, 0001 to December 31, 9999.
Decimal	Decimal	Precision 1 to 28 digits, scale 0 to 28. You cannot use decimal values with precision greater than 28.
Double	Double	Precision 15.
Float	Double	Precision 15.
Int32	Integer	-2,147,483,648 to +2,147,483,647.
Int64	Bigint	-9,223,372,036,854,775,808 to +9,223,372,036,854,775,807. 8-byte signed integer.
Int96	Date/Time	Jan1,0001 to Dec 31, 9999. Precision of 29, scale of 9.
String	String	-1 to 104,857,600 characters.
Time	Date/Time	Time of the day. Precision to microsecond.
Timestamp	Date/Time	January 1, 0001 00:00:00 to December 31, 9999 23:59:59.997. Precision to microsecond. Precision to nanoseconds is not applicable.

The Parquet schema that you specify to read or write a Parquet file must be in smaller case. Case-sensitive schema is not applicable.