hdfs中DataNode启动未报错,在namenodeweb界面发现DataNode少了一个问题解决

首先,查看namenode日志
发现大量的相同报错信息

 ERROR org.apache.hadoop.hdfs.StateChange: BLOCK* NameSystem.getDatanode:
  Data node DatanodeRegistration(192.168.216.102:9866, datanodeUuid=d789da46-1139-4fbe-94a6-a4efdb7ae1dc, 
  infoPort=9864, infoSecurePort=0, ipcPort=9867, storageInfo=lv=-57;cid=CID-0b72ffbb-0179-41ee-905e-fd097c164726;nsid=327303387;c=1602073784643) 
  is attempting to report storage ID d789da46-1139-4fbe-94a6-a4efdb7ae1dc. Node 192.168.216.104:9866 is expected to serve this storage.
ERROR org.apache.hadoop.hdfs.StateChange: BLOCK* NameSystem.getDatanode: 
Data node DatanodeRegistration(192.168.216.104:9866, datanodeUuid=d789da46-1139-4fbe-94a6-a4efdb7ae1dc
, infoPort=9864, infoSecurePort=0, ipcPort=9867, storageInfo=lv=-57;cid=CID-0b72ffbb-0179-41ee-905e-fd097c164726;nsid=327303387;c=1602073784643) 
is attempting to report storage ID d789da46-1139-4fbe-94a6-a4efdb7ae1dc. Node 192.168.216.102:9866 is expected to serve this storage.

可能是之前数次将namenode格式化,还是未知的误操作,导致了102节点和104节点的/opt/module/hadoop-3.1.3/data/dfs/data/current/VERSION文件中datanode的storageID和datanodeUuid是一样的

最终,

2020-12-23 13:02:14,963 INFO org.apache.hadoop.net.NetworkTopology: Removing a node: /default-rack/192.168.216.104:9866
2020-12-23 13:02:14,963 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /default-rack/192.168.216.102:9866


2020-12-23 13:02:14,886 INFO org.apache.hadoop.net.NetworkTopology: Removing a node: /default-rack/192.168.216.102:9866
2020-12-23 13:02:14,887 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /default-rack/192.168.216.104:9866

导致102和104只能同时存在一个!
解决方案:修改$HADOOP_HOME/data/dfs/data/current下的VERSION文件中的storageID和datanodeUuid使得102和104不一样即可

#Wed Dec 23 15:25:55 CST 2020
storageID=DS-1c05934e-0889-4d3d-9adb-130ee65c7e2d
clusterID=CID-0b72ffbb-0179-41ee-905e-fd097c164726
cTime=0
datanodeUuid=d789da46-1139-4fbe-94a6-a4efdb7ae1dd
storageType=DATA_NODE
layoutVersion=-57
  • 3
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 2
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论 2
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值