查看日志报错如下:
2021-04-24 15:00:17,359 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /home/hadoop/bdlog/hadoop/tmp/dfs/data/in_use.lock acquired by nodename 11815@apa-node01
2021-04-24 15:00:17,360 WARN org.apache.hadoop.hdfs.server.common.Storage: Failed to add storage directory [DISK]file:/home/hadoop/bdlog/hadoop/tmp/dfs/data/
java.io.IOException: Incompatible clusterIDs in /home/hadoop/bdlog/hadoop/tmp/dfs/data: namenode clusterID = CID-e1eaca99-ed3a-4e69-b9bc-fffe353db940; datanode clusterID = CID-0567dd7f-dc34-4411-9276-762bdfa84a53
at org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:775)
at org.apache.hadoop.hdfs.server.datanode.DataStorage.loadStorageDirectory(DataStorage.java:300)
at org.apache.hadoop.hdfs.server.datanode.DataStorage.loadDataStorage(DataStorage.java:416)
at org.apache.hadoop.hdfs.server.datanode.DataStorage.addStorageLocations(DataStorage.java:395)
at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:573)
at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1393)
at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1358)
at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:313)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:216)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:637)
at java.lang.Thread.run(Thread.java:748)
解决方法:删除掉所有节点tmp目录下的dfs文件夹,然后启动每个节点的journalnode进程,然后在主节点上对namenode格式化(bin/hdfs namenode -format),格式化zkfc(bin/hdfs zkfc -formatZK),同步数据到备用节点,完成后停止journalnode进程,重新启动集群。