Configuring YARN in Informatica Big Data Management®

Configuring YARN in Informatica Big Data Management®

Hadoop Administrator Tasks

Hadoop Administrator Tasks

Before the Informatica administrator and the Informatica developer can use node labels, the Hadoop administrator must configure the node labels on the Hadoop cluster.
The Hadoop administrator must complete the following tasks:
Verify the scheduler on the cluster.
Ensure that the Hadoop cluster uses a capacity scheduler to allocate resources. If the cluster does not use a capacity scheduler, you cannot configure node labels.
Create and assign node labels to cluster nodes.
Create the node labels that you want to use. Assign the node labels to nodes in the cluster.
Configure YARN queues to use node labels.
Associate the node labels on the cluster with YARN queues, and specify the capacity for each node label. The node labels that a queue can access must be accessible by the queue's parent queue.

0 COMMENTS

We’d like to hear from you!