解决org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode

最新推荐文章于 2024-09-03 09:20:17 发布

Julian Win

最新推荐文章于 2024-09-03 09:20:17 发布

阅读量2w

点赞数 4

分类专栏：大数据文章标签： HBASE

本文链接：https://blog.csdn.net/perfer258/article/details/81812531

版权

在运行MapReduce作业向HBase写数据时，遇到HMaster和HRegionServer进程挂掉的问题，原因是HBase进程的CMS垃圾回收触发不当导致频繁Full GC。解决方案是调整CMSInitiatingOccupancyFraction参数，将其设置为70，以减少Full GC的发生。

摘要由CSDN通过智能技术生成

问题描述

每次一运行MapReduce作业向HBase里面写数据，主节点的HMaster和HRegioServer进程就会挂掉。查看HBase日志发现，

WARN [PEWorker-1] coordination.SplitLogManagerCoordination: Failed to check remaining tasks
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/splitWAL
   at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1532)
   at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.getChildren(RecoverableZooKeeper.java:278)
   at org.apache.hadoop.hbase.zookeeper.ZKUtil.listChildrenNoWatch(ZKUtil.java:500)
   at org.apache.hadoop.hbase.coordination.ZKSplitLogManagerCoordination.remainingTasksInCoordination(ZKSplitLogManagerCoordination.java:125)
   at org.apache.hadoop.hbase.master.SplitLogManager.waitForSplittingCompletion(SplitLogManager.java:326)
   at org.apache.hadoop.hbase.master.SplitLogManager.splitLogDistributed(SplitLogManager.java:258)
   at org.apache.hadoop.hbase.master.MasterWalManager.splitLog(MasterWalManager.java:293)
   at org.apache.hadoop.hbase.master.MasterWalManager.splitMetaLog(MasterWalManager.java:232)
   at org.apache.hadoop.hbase.master.MasterWalManager.splitMetaLog(MasterWalManager.java:224)
   at org.apache.hadoop.hbase.master.procedure.RecoverMetaProcedure.executeFromState(RecoverMetaProcedure.java:129)
   at org.apache.hadoop.hbase.master.procedure.RecoverMetaProcedure.executeFromState(RecoverMetaProcedure.java:52)
   at org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:184)
   at org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:850)
   at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1472)
   at org.apache.hadoop.hbase.procedure2.Proce