问题描述:
Hadoop集群正常启动状态,MR程序或者Spark程序执行成功,查看历史日志记录出现以下问题:
Failed redirect for container_1400260444475_3309_01_000001
Failed while trying to construct the redirect url to the log server. Log Server url may not be configured Unknown container. Container either has not started or has already completed or doesn't belong to this node at all.
解决方法:
1、mapred-site.xml添加:
<name>mapreduce.jobhistory.address </name>
<value>hostName:10020</value>
<name>mapreduce.jobhistory.webapp.address</name>
<value>hostName:19888</value>
2、yarn-site.xml添加:
<property>
<name>yarn.log.server.url</name>
<value>http://<LOG_SERVER_HOSTNAME>:19888/jobhistory/logs</value>
</property>
3、启动history server
mr-jobhistory-daemon.sh start historyserver