Hadoop之Yarn的配置（详细步骤）

配置

先进入hadoop-2.7.6/etc/hadoop

 cd /home/ZQ/hadoop-2.7.6/etc/hadoop/

配置 mapred-site.xml

 vim mapred-site.xml

增加如下内容

<configuration>

  <property>

       <name>mapreduce.framework.name</name>

       <value>yarn</value>

  </property>

</configuration>

配置 yarn-site.xml 

vim yarn-site.xml 

增加如下内容

<configuration>

  <property>

        <name>yarn.nodemanager.aux-services</name>

        <value>mapreduce_shuffle</value>

  </property>

 <property>

       <name>yarn.resourcemanager.address</name>

        <value>westgisB062:8032</value>

</property>

<property>

<name>yarn.resourcemanager.scheduler.address</name>

        <value>westgisB062:8030</value>

  </property>

 <property>

        <name>yarn.resourcemanager.resource-tracker.address</name>
        <value>westgisB062:8031</value>

  </property>

<property>

        <name>yarn.nodemanager.memory-mb</name>

        <value>8GB</value>

</property>

<property>

        <name>yarn.nodemanager.cpu-vcores</name>

        <value>4</value>

</property>

</configuration>

将配置文件拷贝到其他节点

以其中一个节点为例，其他节点同理（拷贝到所有节点）

scp -r /home/ZQ/hadoop-2.7.6/etc/hadoop/mapred-site.xml ZQ@10.103.105.59:/home/ZQ/hadoop-2.7.6/etc/hadoop

scp -r /home/ZQ/hadoop-2.7.6/etc/hadoop/yarn-site.xml ZQ@10.103.105.59:/home/ZQ/hadoop-2.7.6/etc/hadoop

集群的操作和查看

 启动集群

$HADOOP_HOME/sbin/start-dfs.sh

start-dfs.sh

$HADOOP_HOME/sbin/start-yarn.sh

start-yarn.sh

 查看集群

jps

   

HDFS

http://10.103.105.62:50070

/*10.103.105.62为NameNode所在节点的机器名*/

YARN

http://10.103.105.62:8088

/*10.103.105.62为ResourceManager所在节点的机器名*/

 停止集群

$HADOOP_HOME/sbin/stop-yarn.sh

stop-yarn.sh

$HADOOP_HOME/sbin/stop-dfs.sh

stop-dfs.sh