检查hdfs数据大小_如何在HDFS中强制元数据检查点？

最新推荐文章于 2024-02-04 13:51:00 发布

cuma2369

最新推荐文章于 2024-02-04 13:51:00 发布

阅读量172

点赞数

文章标签： hadoop hdfs 大数据 java spark

原文链接：https://www.systutorials.com/how-to-force-a-checkpointing-of-metadata-in-hdfs/

版权

检查hdfs数据大小

HDFS SecondaraNameNode log shows

HDFS SecondaraNameNode日志显示

2017-08-06 10:54:14,488ERROR org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Exception in doCheckpoint
java.io.IOException: Inconsistent checkpoint fields.
LV = -63 namespaceID = 1920275013 cTime = 0 ; clusterId = CID-f38880ba-3415-4277-8abf-b5c2848b7a63 ; blockpoolId = BP-578888813-10.6.1.2-1497278556180.
Expecting respectively: -63; 263120692; 0; CID-d22222fd-e28a-4b2d-bd2a-f60e1f0ad1b1; BP-622207878-10.6.1.2-1497242227638.
at org.apache.hadoop.hdfs.server.namenode.CheckpointSignature.validateStorageInfo(CheckpointSignature.java:134)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:531)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:395)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$1.run(SecondaryNameNode.java:361)
at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:415)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:357)

It seems the checkpoint is broken.

似乎检查点已损坏。

How to force a checkpointing of metadata in HDFS?

如何在HDFS中强制元数据检查点？

You can check this tutorial for how to force a checkpointing of metadata in HDFS:

您可以查看本教程，了解如何在HDFS中强制执行元数据检查点：

How to force a metadata checkpointing in HDFS

如何在HDFS中强制执行元数据检查点

Answered by Eric Z Ma.

埃里克·马（Eric Z Ma）回答。