Table of Contents

Search

  1. Preface
  2. Part 1: Version 10.4.1
  3. Part 2: Version 10.4.0
  4. Part 3: Version 10.2.2
  5. Part 4: Version 10.2.1
  6. Part 5: Version 10.2
  7. Part 6: Version 10.1.1
  8. Part 7: Version 10.1

Technical Preview Lifted

Technical Preview Lifted

Effective in version 10.4.0.1, the following functionalities are lifted from technical preview:
Databricks delta table as streaming mapping target
For Data Engineering Streaming, you can use Databricks delta table as a target of streaming mapping for the ingestion of streaming data.
Dynamic streaming mapping
You can configure dynamic streaming mappings to change Kafka sources and targets at run time based on the parameters and rules that you define in a Confluent Schema Registry.
Hive Warehouse Connector and Hive LLAP
For Data Engineering products, use the Hive Warehouse Connector and Hive LLAP with Azure HDInsight 4.x and Hortonworks HDP 3.x clusters to enable Spark code to interact with Hive tables and allow ACID-enabled Hive tables on the Spark engine.
For more information, see the "Mapping Optimizations" chapter in the
Data Engineering Integration 10.4.1 User Guide
.
Snowflake as a streaming mapping target
For Data Engineering Streaming, you can configure Snowflake as a target in a streaming mapping to write data to Snowflake.


Updated August 28, 2020