1、etc/hadoop/mapred-site.xml (MapReduce运行在yarn框架上)
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
<property>
<property>
<name>mapreduce.jobhistory.address</name>
<value>bigdata-pro01.kfk.com:10020</value>
<property>
<property>
<name>mapreduce.jobhistory.webapp.address</name>
<value>bigdata-pro01.kfk.com:19888</value>
<property>
</configuration>
2、配置yarn-site.xml
<configuration>
<property> <name>yarn.nodemanager.aux-services</name> <value>mapreduce_shuffle</value> </property>
<property> <name>yarn.resourcemanager.hostname</name> <value>bigdata-pro01.kfk.com</value> </property>
<property> <name>yarn.log-aggregation-enable</name> <value>true</value> </property>
<property> <name>yarn.log-aggregation.retain-seconds</name> <value>10000</value> </property>
</configuration>
3、/opt/datas/ 创建一个文件
touch wc.input
bin/hdfs dfs -put /opt/datas/wc.input /user/kfk/data
4、启动yarn(端口8088 )
sbin/yarn-daemon.sh start resourcemanager
sbin/yarn-daemon.sh start nodemanager
jps //查看开启的进程
5、启动MapReduce的日志进程
在/opt/modules/hadoop-2.5.0/sbin
./mr-jobhistory-daemon.sh start historyserver