最近在弄hadoop2.0,把遇到的一些问题做个笔记:
版本:apache hadoop-2.2.0
2013-10-29
在启动nodemanager的时候报下面的错误:
2013-10-29 11:32:21,523 FATAL org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting NodeManager
java.lang.IllegalArgumentException: The ServiceName: mapreduce.shuffle set in yarn.nodemanager.aux-services is invalid.The valid service name should only
contain a-zA-Z0-9_ and can not start with numbers
或者提交作业出现类似下面的错误:
3/10/29 11:49:01 INFO mapreduce.Job: Task Id : attempt_1383017347984_0001_m_000000_0, Status : FAILED
Container launch failed for container_1383017347984_0001_01_000002 : org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException: The auxService:
mapreduce_shuffle does not exist
解决办法:
在yarn-site.xml 配置文件中增加: