Configuring YARN in Informatica Big Data Management®

Configuring YARN in Informatica Big Data Management®

Fair Scheduler

Fair Scheduler

A fair scheduler allows the users in an organization to share resources evenly on a Hadoop cluster.
The scheduler distributes resources using weights. The weights determine the amount of cluster resources that are available to a queue. The available resources in a queue are shared evenly between jobs in the queue.
When you use a fair scheduler, smaller jobs that require less time can access resources that are being used by larger jobs. As a result, users do not have to wait for larger jobs to finish before smaller jobs can run.
You cannot use a fair scheduler with node labeling.

0 COMMENTS

We’d like to hear from you!