yarn伪分布式

yarn配置
单一节点至多启动一个节点
1.vim yarn-env.sh
export JAVA_HOME=/opt/module/jdk1.8.0_221
2.vim yarn-site.xml

<property>
            <name>yarn.nodemanager.aux-services</name>
                    <value>mapreduce_shuffle</value>
                        </property>
       

   <property>
             <name>yarn.resourcemanager.hostname</name>//指定yarn的resourceManager的地址
                    <value>hadoop101</value>
                        </property>
	

1. vim mapred-env.sh

        export JAVA_HOME=/opt/module/jdk1.8.0_221
   

2. //mapred-site.xml里面是空的，把mapred-site.xml.template文件copy给mapred-site.xml

cp mapred-site.xml.template mapred-site.xml

ll
vim  mapred-site.xml

 <property>
         <name>mapreduce.framework.name</name>//指定MR运行在yarn上
                 <value>yarn</value>       
  </property>

5.启动yarn(hadoop-2.7.2目录)

yarn-daemon.sh start resourcemanager
yarn-daemon.sh start nodemanager

jps后出现 NodeManager NameNode DataNode jps ResourceManager

http://hadoop101:8088/cluster

6.在hdfs和Yarn上的MapReduce程序

hadoop fs -put wcinput /          #在网页上Utilities中有wcinput
hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.2.jar wordcount /wcinput /wcoutput

在网页上Utilities中有wcinput、wcoutput、tmp
7.hadoop fs -cat /wcoutput/*
atguigu 2
hadoop 2
mapreduce 1
yarn 1