Data Engineering Streaming
- Data Engineering Streaming 10.2.1
- All Products
Parquet
| Transformation
| Description
|
---|---|---|
Binary
| Binary
| 1 to 104,857,600 bytes
|
Binary (UTF8)
| String
| 1 to 104,857,600 characters
|
Boolean
| Integer
| -2,147,483,648 to 2,147,483,647
Precision of 10, scale of 0
|
Double
| Double
| Precision of 15 digits
|
Fixed Length Byte Array
| Decimal
| Decimal value with declared precision and scale. Scale must be less than or equal to precision.
For transformations that support precision up to 38 digits, the precision is 1 to 38 digits, and the scale is 0 to 38.
For transformations that support precision up to 28 digits, the precision is 1 to 28 digits, and the scale is 0 to 28.
If you specify the precision greater than the maximum number of digits, the Data Integration Service converts decimal values to double in high precision mode.
|
Float
| Double
| Precision of 15 digits
|
group (LIST)
| Array
| Unlimited number of characters.
|
Int32
| Integer
| -2,147,483,648 to 2,147,483,647
Precision of 10, scale of 0
|
Int64
| Bigint
| -9,223,372,036,854,775,808 to 9,223,372,036,854,775,807
Precision of 19, scale of 0
|
Int64 (TIMESTAMP_MILLIS)
| Date/Time
| Jan 1, 0001 A.D. to Dec 31, 9999 A.D.
Precision of 29, scale of 9
(precision to the nanosecond)
Combined date/time value.
|
Int96
| Date/Time
| Jan 1, 0001 A.D. to Dec 31, 9999 A.D.
Precision of 29, scale of 9
(precision to the nanosecond)
Combined date/time value.
|
Map
| Map
| Unlimited number of characters.
|
Struct
| Struct
| Unlimited number of characters.
|
Union
| Corresponding primitive data type in a union of ["primitive_type", "null"] or ["null", "primitive_type"].
| Dependent on primitive data type.
|