Data preview on the Spark engine
For Data Engineering Integration, you can preview data within a mapping that runs on the Spark engine from the Developer tool for mappings configured to run with Amazon EMR, Cloudera CDH, and Hortonworks HDP. Previewing data in mappings configured to run with Azure HDInsight and MapR is still available for technical preview.
PowerExchange for Amazon S3
For Data Engineering Integration, you can use intelligent structure models when importing a data object.
PowerExchange for Microsoft Azure Cosmos DB SQL API
For Data Engineering Integration, you can develop and run mappings in the Azure Databricks environment.
PowerExchange for Microsoft Azure SQL Data Warehouse
For Data Engineering Integration, you can use the following functionalities:
Create and run dynamic mappings.
Use full pushdown optimization when an ODBC connection is used to connect to the Microsoft Azure SQL Data Warehouse database.
SSL-enabled Kafka connections
For Data Engineering Streaming, you can use SSL-enabled Kafka connections for streaming mappings.