Data Engineering Integration
- Data Engineering Integration 10.5.1
- All Products
File Type
| Supported Formats
| Supported Engines
|
---|---|---|
Avro
|
| Spark
|
Intelligent Structure Model or Sample File
|
| Spark
|
JSON
|
| Spark
|
Parquet
|
| Spark
|
1 To run on the Spark engine, the complex file read operation must be enabled to project columns as complex data type.
|
File Type
| Supported Formats
| Supported Engines
|
---|---|---|
Avro
|
|
|
JSON
|
|
|
ORC
|
|
|
Parquet
|
|
|
1 To run on the Blaze engine, the complex file data object must be connected to a Data Processor transformation.
2 To run on the Spark engine, the complex file read operation must be enabled to project columns as complex data type.
|