What's New and Changed (10.5.2)

Back Next

Data Engineering Streaming

Read this section to learn what's new for Data Engineering Streaming in version 10.5.1.1.

Data Preview: Effective in version 10.5.1.1, you can preview data within a streaming mapping that runs on the Spark engine in the Developer tool. Previewing data helps to design and debug streaming mappings.
For information about data preview, see the
Data Engineering Streaming User Guide
.
Auto-scaling: Effective in version 10.5.1.1, you can enable auto-scale and run a streaming mapping on Databricks cluster. When you enable auto-scaling, the Databricks cluster automatically adds or subtracts cluster core and task nodes when Spark mappings activate performance thresholds.
For information about auto-scaling, see the
Data Engineering Integration User Guide
.