etc/hadoop/mapred-site.xml
添加下面的配置:
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
</configuration>
etc/hadoop/yarn-site.xml
添加下面的配置:
<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.local-dirs</name>
<value>/home/iie4bu/app/tmp/hadoop-tmp/nm-local-dir</value>
</property>
<!-- 用yarn logs -applicationId application_1692763927489_0001时需要进行配置, 否则 -->
<property>
<name>yarn.log-aggregation-enable</name>
<value>true</value>
</property>
</configuration>
如果不设置yarn.log-aggregation-enable
会出现/tmp/logs/iie/logs/application_xxxxxxx does not exist
启动ResourceManager进程和NodeManager进程
sbin/start-yarn.sh
访问Resource Manager
浏览器中输入地址http://ip:8088
表示存活的Node个数是1个。
运行一个作业
在hadoop-2.6.0-cdh5.15.1/share/hadoop/mapreduce
路径下有一个hadoop-mapreduce-examples-2.6.0-cdh5.15.1.jar
示例文件,里面有很多测试方法。
运行命令:
hadoop jar hadoop-mapreduce-examples-2.6.0-cdh5.15.1.jar wordcount /input/wc/hello.txt /output/wc/