Data Engineering Integration All Products
Complex Data Type
An array is an ordered collection of elements.
The elements can be of a primitive or complex data type. All elements in the array must be of the same data type.
A map is an unordered collection of key-value pair elements.
The key must be of a primitive data type. The value can be of a primitive or complex data type.
The Spark engine can read, pass through, and write map data but cannot generate or process map data.
A struct is a collection of elements of different data types.
The elements can be of primitive or complex data types. Struct has a schema that defines the structure of the data.