Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Big Data Management
  3. Connections
  4. Mappings in a Hadoop Environment
  5. Mapping Objects in a Hadoop Environment
  6. Mappings in the Native Environment
  7. Profiles
  8. Native Environment Optimization
  9. Data Type Reference
  10. Function Reference
  11. Parameter Reference

Big Data Management Engines

Big Data Management Engines

When you run a mapping in theHadoop environment, you can choose the environment to run the mapping in, native environment or Hadoop environment. If you run the mapping in the Hadoop environment, the mapping will run on the Blaze engine, the Spark engine, or the Hive engine.
When you validate a mapping, you can validate it against one or all of the engines. The Developer tool returns validation messages for each engine. You can then choose to run the mapping in the native environment or in a Hadoop environment or in the native environment. When you run the mapping in the native environment, the Data Integration Service processes the mapping logic. When you run the mapping in the Hadoop environment, the Data Integration Service determines the best engine to run the mapping. The Data Integration Service translates the mapping logic into code that the engine can process, and it transfers the code to the engine.


Updated July 03, 2018