Hive整合Hbase 解决map=100% reduce=0%的问题

搭建过程致谢：

https://www.cnblogs.com/yfb918/p/10882323.html

https://blog.csdn.net/dajiangtai007/article/details/79696853

 

我当时在从hive插入到hbase表的时候，一直卡在map=100% reduce=0%

查询日志找到原因：

2021-04-17 06:18:12,884 ERROR [main] org.apache.hadoop.hbase.client.AsyncProcess: Failed to get region location 
org.apache.hadoop.hbase.DoNotRetryIOException: java.lang.NoSuchMethodError: org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest$Builder.setTrackScanMetrics(Z)Lorg/apache/hadoop/hbase/protobuf/generated/ClientProtos$ScanRequest$Builder;
    at org.apache.hadoop.hbase.client.RpcRetryingCaller.translateException(RpcRetryingCaller.java:241)
    at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:214)
    at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:364)
    at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:338)
    at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:137)
    at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:65)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NoSuchMethodError: org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest$Builder.setTrackScanMetrics(Z)Lorg/apache/hadoop/hbase/protobuf/generated/ClientProtos$ScanRequest$Builder;
    at org.apache.hadoop.hbase.protobuf.RequestConverter.buildScanRequest(RequestConverter.java:500)
    at org.apache.hadoop.hbase.client.ClientSmallReversedScanner$SmallReversedScannerCallable.call(ClientSmallReversedScanner.java:291)
    at org.apache.hadoop.hbase.client.ClientSmallReversedScanner$SmallReversedScannerCallable.call(ClientSmallReversedScanner.java:276)
    at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:212)
    ... 7 more

与hbase相关，那就是jar包有问题

回到hive的lib目录下面发现拷贝过来的jar包有hive自带的，版本不一致，删除自带的即可！