hadoop默认调度策略
I want to change policy of scheduling in Hadoop, how to I can change job order in map reduce automatically.
我想更改Hadoop中的调度策略,如何自动更改map中的作业顺序。
Assume you are using Hadoop 2 / YARN.
假设您正在使用Hadoop 2 / YARN。
The configuration parameter named yarn.resourcemanager.scheduler.class
controls the class to be used as the resource scheduler for YARN/Hadoop.
名为yarn.resourcemanager.scheduler.class
的配置参数控制用作YARN / Hadoop的资源调度程序的类。
The default value for the scheduler class (check more at https://www.systutorials.com/241248/hadoop-2-yarn-default-configuration-values/) is:
调度程序类的默认值(有关更多信息, 请参见https://www.systutorials.com/241248/hadoop-2-yarn-default-configuration-values/ ):
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler
which is the Capacity Scheduler.
这是容量调度程序。
To change the scheduler used, you need to assign the scheduler class in yarn-site.xml in the etc/hadoop/ directory under Hadoop installation. Taking the fair scheduler shipped with Hadoop as an example, we can add to yarn-site.xml:
要更改使用的调度程序,您需要在Hadoop安装目录下etc / hadoop /目录的yarn-site.xml中分配调度程序类。 以Hadoop随附的公平调度程序为例,我们可以添加到yarn-site.xml中:
<property>
<name>yarn.resourcemanager.scheduler.class</name>
<value>org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler</value>
</property>
Each scheduler may have its own options for configurations, such as capacity scheduler and fair scheduler. You may check their manuals to configure and tune them.
每个调度程序可能都有自己的配置选项,例如容量调度程序和公平调度程序 。 您可以查看他们的手册以进行配置和调整。
翻译自: https://www.systutorials.com/how-change-my-policy-of-scheduling-in-hadoop/
hadoop默认调度策略