org.apache.hadoop.hbase.NotServingRegionException: table_name,row_ky,xxx.xxx. is not online on xxx,x

最新推荐文章于 2023-10-20 12:53:28 发布

种豆大叔

最新推荐文章于 2023-10-20 12:53:28 发布

阅读量599

点赞数

分类专栏： spark habse hive 文章标签： spark hbase 大数据 hadoop region

本文链接：https://blog.csdn.net/qq_35921007/article/details/105512721

版权

在使用Spark进行HBase到Hive的数据同步过程中，遇到了`org.apache.hadoop.hbase.NotServingRegionException`错误。通过执行`sudo -u hbase hbase hbck`检测到HBase的区域错误。在HBase shell中进一步排查，发现Region状态异常。文章详细介绍了这个问题的解决方法。

摘要由CSDN通过智能技术生成

场景

使用spark同步hbase数据至hive

报错信息

at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:276)
at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:207)
at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:60)
at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200)
at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:320)
at org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:295)
at org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction(ClientScanner.java:160)
at org.apache.hadoop.hbase.client.ClientScanner.<init>(ClientScanner.java:155)
at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:802)
at org.apache.hadoop.hbase.mapreduce.TableRecordReaderImpl.restart(TableRecordReaderImpl.java:90)
at org.apache.hadoop.hbase.mapreduce.TableRecordReaderImpl.initialize(TableRecordReaderImpl.java:152)
at org.apache.hadoop.hbase.mapreduce.TableRecordReader.initialize(TableRecordReader.java:134)
at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase$1.initialize(TableInputFormatBase.java:211)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.liftedTree1$1(NewHadoopRDD.scala:180)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.<init>(NewHadoopRDD.scala:177)
at org.apache.spark.rdd.NewHadoopRDD.compute(NewHadoopRDD.scala:134)
at org.apache.spark.rdd.NewHadoopRDD.compute(NewHadoopRDD.scala:69)
at org.apache.spark.rdd.RDD.computeOrRe

最低0.47元/天解锁文章