Preface
Introduction to Data Engineering Streaming
Data Engineering Streaming Administration
Sources in a Streaming Mapping
Targets in a Streaming Mapping
Streaming Mappings
Window Transformation
Appendix A: Connections
Appendix B: Monitoring REST API Reference
- Monitoring REST API Reference
Appendix C: Sample Files
- Sample Files

User Guide

10.4.0
- 10.5.4
- 10.5.2
- 10.5.1
- 10.5
- 10.4.1
- 10.2.2 Service Pack 1
- 10.2.2
- 10.2.1

Back Next

Third-Party Applications

Data Engineering Streaming uses third-party distributions to connect to a Spark engine on a Hadoop cluster or to a Databricks Spark engine on a Databricks cluster.

In a Hadoop environment, Data Engineering Streaming pushes job processing to the Spark engine. It uses YARN to manage the resources on a Spark cluster.

In a Databricks environment, Data Engineering Streaming pushes job processing to the Databricks cluster, and the Databricks Spark engine runs the job.

Component Architecture

Rename Saved Search

Table of Contents

User Guide

User Guide

Third-Party Applications

Third-Party Applications