Hadoop 的namenode一直处于standby状态,kill掉另一个namenode这也不能active,查看日志
WARNorg.apache.hadoop.hdfs.server.namenode.NameNodeResourceChecker: paceavailable on volume '/dev/mapper/vg_master-lv_root' is 0 which isbelow the configured reserved amount 104857600
2017-01-05 18:45:35,044 INFOorg.apache.hadoop.ipc.Server: IPC Server handler 1 on 9000, callorg.apache.hadoop.ha.HAServiceProtocol.monitorHealth from 219.217.203.1:43311Call#29901 Retry#0
org.apache.hadoop.ha.HealthCheckFailedException:The NameNode has no resources available
atorg.apache.hadoop.hdfs.server.namenode.NameNode.monitorHealth(NameNode.java:1572)
atorg.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.monitorHealth(NameNodeRpcServer.java:1470)
atorg.apache.hadoop.ha.protocolPB.HAServiceProtocolServerSideTranslatorPB.monitorHealth(HAServiceProtocolServerSideTranslatorPB.java:75)
atorg.apache.hadoop.ha.proto.HAServiceProtocolProtos$HAServiceProtocolService$2.callBlockingMethod(HAServiceProtocolProtos.java:4458)
atorg.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
atorg.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
atorg.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049)
atorg.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045)
atjava.security.AccessController.doPrivileged(Native Method)
atjavax.security.auth.Subject.doAs(Subject.java:422)
atorg.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
atorg.apache.hadoop.ipc.Server$Handler.run(Server.java:2043)
我们可以看到
Space available on volume'/dev/mapper/vg_master-lv_root' is 0,显示 root目录的可用空间为0,df –h查看后
确实如此
解决方法:①找到目录中文件比较大的,拷贝到别的目录下,是root的空间充足。
②、扩展vg_master-lv_root的空间。
方法二可参考 https://zhidao.baidu.com/question/93255552.html,很详细。