Table of Contents

Search

  1. Preface
  2. Informatica Developer
  3. The Model Repository
  4. Searches in Informatica Developer
  5. Connections
  6. Physical Data Objects
  7. Flat File Data Objects
  8. Logical View of Data
  9. Viewing Data
  10. Application Deployment
  11. Application Patch Deployment
  12. Application Patch Deployment Example
  13. Continuous Integration and Continuous Delivery (CI/CD)
  14. Object Import and Export
  15. Appendix A: Data Type Reference
  16. Appendix B: Keyboard Shortcuts
  17. Appendix C: Connection Properties

Developer Tool Guide

Developer Tool Guide

Avro Data Types and Transformation Data Types

Avro Data Types and Transformation Data Types

Avro data types map to transformation data types that the Data Integration Service uses to move data across platforms.
The following table compares the Avro data types that the Data Integration Service supports and the corresponding transformation data types:
Avro Data Type
Transformation Data Type
Range
Array
Array
Unlimited number of characters.
Boolean
Integer
TRUE (1) or FALSE (0).
Bytes
Binary
Precision 4000.
Date
Date/Time
January 1, 0001 to December 31, 9999.
Decimal
Decimal
Decimal value with declared precision and scale. Scale must be less than or equal to precision.
For transformations that support precision up to 38 digits, the precision is 1 to 38 digits, and the scale is 0 to 38.
For transformations that support precision up to 28 digits, the precision is 1 to 28 digits, and the scale is 0 to 28.
If you specify the precision greater than the maximum number of digits, the Data Integration Service converts decimal values to double in high precision mode.
Double
Double
Precision 15.
Fixed
Binary
1 to 104,857,600 bytes.
Float
Double
Precision 15.
Int
Integer
-2,147,483,648 to 2,147,483,647 Precision 10 and scale 0.
Long
Bigint
-9,223,372,036,854,775,808 to 9,223,372,036,854,775,807.
Precision 19 and scale 0.
Map
Map
Unlimited number of characters.
Record
Struct
Unlimited number of characters.
String
String
1 to 104,857,600 characters.
Time
Date/Time
Time of the day. Precision to microsecond.
Timestamp
Date/Time
January 1, 0001 00:00:00 to December 31, 9999 23:59:59.997.
Precision to microsecond.
Union
Corresponding data type in a union of ["primitive_type|complex_type", "null"] or ["null", "primitive_type|complex_type"].
Dependent on primitive or complex data type.

Avro Union Data Type

A union indicates that a field might have more than one data type. For example, a union might indicate that a field can be a string or a null. A union is represented as a JSON array containing the data types.
The Developer tool only interprets a union of ["primitive_type|complex_type", "null"] or ["null", "primitive_type|complex_type"]. The Avro data type converts to the corresponding transformation data type.

Avro Timestamp Data Type Support

The following table lists the Timestamp data type support for Avro file formats:
Timestamp Data type
Native
Spark
Timestamp_micros
Yes
Yes
Timestamp_millis
Yes
No
Time_millis
Yes
No
Time_micros
Yes
No

Unsupported Avro Data Types

The Developer tool does not support the following Avro data types:
  • Enum
  • Null
  • Timestamp_tz

0 COMMENTS

We’d like to hear from you!