问题背景
Apache Spark2 整合 Hbase2 的时候报错
.
问题内容
出现两次错误
第一个: Exception in thread “main” java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/mapreduce/TableInputFormatBase
----------------------------------分割线---------------------------------------------------------------
第二个: 2021-04-02 17:49:01,986 ERROR thriftserver.SparkSQLDriver: Failed in [select * from table]
org.apache.hadoop.hbase.DoNotRetryIOException: java.lang.NoClassDefFoundError: org/apache/htrace/core/HTraceConfiguration\
.
问题分析
首先第一个问题:原因是因为某些jar包没有引入,需要引入一下。
第二个问题:是因为某一个jar没有引入,导致的错误。
.
解决方案
报错信息
Exception in thread “main” java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/mapreduce/TableInputFormatBase
每台worker节点,执行以下语句
scp $HBASE_HOME/lib/hbase-* $SPARK_HOME/jars/
scp $HBASE_HOME/lib/client-facing-thirdparty/htrace-core4-4.2.0-incubating.jar $SPARK_HOME/jars/
.
------------------------------------分割线-------------------------------------------------------------
.
报错信息
2021-04-02 17:49:01,986 ERROR thriftserver.SparkSQLDriver: Failed in [select * from table]
org.apache.hadoop.hbase.DoNotRetryIOException: java.lang.NoClassDefFoundError: org/apache/htrace/core/HTraceConfiguration
at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.translateException(RpcRetryingCallerImpl.java:221)
at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:194)
at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:267)
at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:435)
at org.apache.h