Configuring a Mapping to Run in a Hadoop Environment
Configuring a Mapping to Run in a Hadoop Environment
You can configure a mapping to run in a Hadoop environment. To configure a mapping, you must select the Hadoop validation environment and a Hadoop connection.
Select a mapping from a project or folder from the
Object Explorer
view to open in the editor.
In the
Properties
view, select the
Run-time
tab.
Select
Hadoop
as the value for the validation environment.
The Hive on MapReduce, the Blaze, and the Spark engines are selected by default. To only use the Hive on MapReduce engine, clear the other engines. If you use the Blaze engine, you cannot clear the Hive on MapReduce engine.
In the execution environment, select
Hadoop
.
In the Hadoop environment, select
Connection
and use the drop down in the value field to browse for a connection or create a connection parameter:
To select a connection, click
Browse
and select a connection.
To create a connection parameter, click
Assign Parameter
.
Optionally, select
Execution Parameters
to override a Hadoop custom property or a Spark default configuration parameter.
