User Guide

10.5.4
- 10.5.7
- 10.5.2
- 10.5.1
- 10.5
- 10.4.1
- 10.4.0
- 10.2.2 Service Pack 1
- 10.2.2
- 10.2.1

Back Next

Data Engineering Streaming Engines

When you run a streaming mapping, you can choose to run the mapping in a Hadoop environment or in a Databricks environment. When you validate a mapping, you can validate it against one or all of the engines. The Developer tool returns validation messages for each engine.

When you run a streaming mapping, the Data Integration Service uses a proprietary rule-based methodology to determine the best engine to run the mapping. The rule-based methodology evaluates the mapping sources and the mapping logic to determine the engine. The Data Integration Service translates the mapping logic into code that the engine can process, and it transfers the code to the engine.

For more information about the run-time process on the different engines, see

Data Engineering Integration User Guide

Introduction to Data Engineering Streaming

Download Guide

Watch

Comments

Communities

Knowledge Base

Success Portal