Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange for Google BigQuery
  3. PowerExchange for Google BigQuery Configuration
  4. Configuring HTTP Proxy Options
  5. Google BigQuery Connections
  6. PowerExchange for Google BigQuery Data Objects
  7. PowerExchange for Google BigQuery Mappings
  8. Google BigQuery Lookup
  9. Google BigQuery Run-Time Processing
  10. Appendix A: Google BigQuery Data Type Reference

PowerExchange for Google BigQuery User Guide

PowerExchange for Google BigQuery User Guide

Mapping Validation and Run-time Environments

Mapping Validation and Run-time Environments

You can validate and run mappings in the native environment or with the Spark engine in the Hadoop environment.
The Data Integration Service validates whether the mapping can run in the selected environment. You must validate the mapping for an environment before you run the mapping in that environment.

Native environment

You can configure the mappings to run in the native environment. When you run mappings in the native environment, the Data Integration Service processes the mapping and runs the mapping from the Developer tool.

Spark Engine

When you run mappings on the Spark engine, the Data Integration Service pushes the mapping to a Hadoop cluster and processes the mapping on a Spark engine. The Data Integration Service generates an execution plan to run mappings on the Spark engine.
You can view the plan in the Developer tool before you run the mapping and in the Administrator tool after you run the mapping.
For more information about the Hadoop environment and Spark engines, see the
Informatica
Data Engineering Integration User Guide
.

0 COMMENTS

We’d like to hear from you!