hadoop jobhistory记录下已运行完的MapReduce作业信息并存放在指定的HDFS目录下,默认情况下是没有启动的,需要配置完后手工启动服务。
mapred-site.xml添加如下配置
<property>
<span style="white-space:pre"> </span><name>mapreduce.jobhistory.address</name>
<span style="white-space:pre"> </span><value>hadoop000:10020</value>
<span style="white-space:pre"> </span><description>MapReduce JobHistory Server IPC host:port</description>
</property>
<property>
<span style="white-space:pre"> </span><name>mapreduce.jobhistory.webapp.address</name>
<span style="white-space:pre"> </span><value>hadoop000:19888</value>
<span style="white-space:pre"> </span><description>MapReduce JobHistory Server Web UI host:port</description>
</property>
<property>
<span style="white-space:pre"> </span><name>mapreduce.jobhistory.done-dir</name>
<span style="white-space:pre"> </span><value>/history/done</value>
</property>
<property>
<span style="white-space:pre"> </span><name>mapreduce.jobhistory.intermediate-done-dir</name>
<span style="white-space:pre"> </span><value>/history/done_intermediate</value>
</property>
启动history-server:
$HADOOP_HOME/sbin/mr-jobhistory-daemon.sh start historyserver
停止history-server:
$HADOOP_HOME/sbin/mr-jobhistory-daemon.sh stop historyserver