Configuring YARN in Informatica Big Data Management®

Configuring YARN in Informatica Big Data Management®

Informatica Developer Tasks

Informatica Developer Tasks

After the Hadoop administrators configures the node labels and the Informatica administrator enables node labeling in the domain environment, the Informatica developer can use node labels to run Blaze, Spark, and Hive jobs on nodes that have the node label.
Optionally, the Informatica developer can complete the following task:
Use node labels to run jobs.
To use node labels to run Blaze, Spark, and Hive jobs, the Hadoop administrator must have assigned the node labels to a YARN queue. You must direct the jobs to the queue that is assigned the particular label.
When you run jobs, the jobs are submitted to the configured queue. The node labels that are assigned to the queue determine the nodes where the jobs run.

0 COMMENTS

We’d like to hear from you!