Big Data Management User Guide

Back Next

Enable Scheduling and Node Labeling

To enable scheduling and node labeling in the Hadoop environment, update the yarn-site.xml file in the domain environment.

Configure the following properties:

yarn.resourcemanager.scheduler.class: Defines the YARN scheduler that the Data Integration Service uses to assign resources on the cluster.
<property> <name>yarn.resourcemanager.scheduler.class</name> <value>org.apache.hadoop.yarn.server.resourcemanager.scheduler.[Scheduler Type].[Scheduler Type]Scheduler</value> </property>
For example:
<property> <name>yarn.resourcemanager.scheduler.class</name> <value>org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler</value> </property>
yarn.node-labels.enabled: Enables node labeling.; <property> <name>yarn.node-labels.enabled</name> <value>TRUE</value> </property>
yarn.node-labels.fs-store.root-dir: The HDFS location to update the node label dynamically.; <property> <name>yarn.node-labels.fs-store.root-dir</name> <value>hdfs://[Node name]:[Port]/[Path to store]/[Node labels]/</value> </property>