Hive metastore启动报错The specified datastore driver(“com.mysql.jdbc.Driver“) was not found in the CLASS

最新推荐文章于 2023-12-27 14:59:51 发布
最新推荐文章于 2023-12-27 14:59:51 发布
阅读量1.2k 收藏
点赞数
分类专栏： Hive Cloudera Hadoop 大数据
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/Post_Yuan/article/details/109485741
版权
大数据 同时被 3 个专栏收录
84 篇文章 5 订阅
订阅专栏
Cloudera Hadoop
30 篇文章 1 订阅
订阅专栏
Hive
14 篇文章 1 订阅
订阅专栏

现象

某集群有两个Hive metastore，其中一个正常运行，另一个启动报错，报错的Hive metastore日志报错信息如下，

上午9点56:55.875分	WARN	HiveMetaStore	
[main]: Retrying creating default database after error: Error creating transactional connection factory
javax.jdo.JDOFatalInternalException: Error creating transactional connection factory
	at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:587)
	at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:788)
	at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:333)
	at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:202)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at javax.jdo.JDOHelper$16.run(JDOHelper.java:1965)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.jdo.JDOHelper.invoke(JDOHelper.java:1960)
	at javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1166)
	at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:808)
	at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:701)
	at org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:420)
	at org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:449)
	at org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:344)
	at org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:300)
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:73)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
	at org.apache.hadoop.hive.metastore.RawStoreProxy.<init>(RawStoreProxy.java:60)
	at org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:69)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:685)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:663)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:712)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:511)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:78)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84)
	at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:6511)
	at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:6506)
	at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:6756)
	at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:6683)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.util.RunJar.run(RunJar.java:226)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:141)
NestedThrowablesStackTrace:
java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at org.datanucleus.plugin.NonManagedPluginRegistry.createExecutableExtension(NonManagedPluginRegistry.java:631)
	at org.datanucleus.plugin.PluginManager.createExecutableExtension(PluginManager.java:325)
	at org.datanucleus.store.AbstractStoreManager.registerConnectionFactory(AbstractStoreManager.java:282)
	at org.datanucleus.store.AbstractStoreManager.<init>(AbstractStoreManager.java:240)
	at org.datanucleus.store.rdbms.RDBMSStoreManager.<init>(RDBMSStoreManager.java:286)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at org.datanucleus.plugin.NonManagedPluginRegistry.createExecutableExtension(NonManagedPluginRegistry.java:631)
	at org.datanucleus.plugin.PluginManager.createExecutableExtension(PluginManager.java:301)
	at org.datanucleus.NucleusContext.createStoreManagerForProperties(NucleusContext.java:1187)
	at org.datanucleus.NucleusContext.initialise(NucleusContext.java:356)
	at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:775)
	at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:333)
	at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:202)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at javax.jdo.JDOHelper$16.run(JDOHelper.java:1965)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.jdo.JDOHelper.invoke(JDOHelper.java:1960)
	at javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1166)
	at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:808)
	at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:701)
	at org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:420)
	at org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:449)
	at org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:344)
	at org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:300)
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:73)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
	at org.apache.hadoop.hive.metastore.RawStoreProxy.<init>(RawStoreProxy.java:60)
	at org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:69)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:685)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:663)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:712)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:511)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:78)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84)
	at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:6511)
	at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:6506)
	at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:6756)
	at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:6683)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.util.RunJar.run(RunJar.java:226)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:141)
Caused by: org.datanucleus.exceptions.NucleusException: Attempt to invoke the "BONECP" plugin to create a ConnectionPool gave an error : The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH. Please check your CLASSPATH specification, and the name of the driver.
	at org.datanucleus.store.rdbms.ConnectionFactoryImpl.generateDataSources(ConnectionFactoryImpl.java:259)
	at org.datanucleus.store.rdbms.ConnectionFactoryImpl.initialiseDataSources(ConnectionFactoryImpl.java:131)
	at org.datanucleus.store.rdbms.ConnectionFactoryImpl.<init>(ConnectionFactoryImpl.java:85)
	... 54 more
Caused by: org.datanucleus.store.rdbms.connectionpool.DatastoreDriverNotFoundException: The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH. Please check your CLASSPATH specification, and the name of the driver.
	at org.datanucleus.store.rdbms.connectionpool.AbstractConnectionPoolFactory.loadDriver(AbstractConnectionPoolFactory.java:58)
	at org.datanucleus.store.rdbms.connectionpool.BoneCPConnectionPoolFactory.createConnectionPool(BoneCPConnectionPoolFactory.java:54)
	at org.datanucleus.store.rdbms.ConnectionFactoryImpl.generateDataSources(ConnectionFactoryImpl.java:238)
	... 56 more

解决

根据报错信息，应该是mysql驱动没找到。因为另一个节点Hive metastore可以正常运行，我们使用find命令去正常节点找mysql驱动包，

[root@uathx01 java]# find / -name mysql-connector*.jar
/usr/share/java/mysql-connector-java-5.1.38.jar
/usr/share/java/mysql-connector-java.jar

find命令帮助我们找到了mysql驱动包在/usr/share/java目录下，再使用同样的命令去报错节点find确实没有找到。使用scp命令将驱动包复制到报错节点并添加软链接。重启报错节点的Hive metastore，启动成功。

数据源的港湾
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 打赏
    打赏
  • 0
    评论
专栏目录
Spark SQL报错：The specified datastore driver (“com.mysql.jdbc.Driver“) was not found in the CLASSPATH.
zhengzaifeidelushang的博客
08-13 816
Spark SQL报错：The specified datastore driver (“com.mysql.jdbc.Driver”) was not found in the CLASSPATH. 启动Spark SQL报错： ./spark-sql Caused by: org.datanucleus.exceptions.NucleusException: Attempt to invoke the "BONECP" plugin to create a ConnectionPool gave
Hive启动报错解决合集
weixin_41126842的博客
06-10 3033
如果报很多很多错，看配置文件hive-site.xml里的数据库的name和password正确不 报错可以参考：https://blog.csdn.net/eason_oracle/article/details/52273954 一、报错：org.datanucleus.store.rdbms.connectionpool.DatastoreDriverNotFoundExcepti...
18/12/05 00:26:31 WARN HiveMetaStore: Retrying creating default database after error: Class org.data
张不帅
12-05 1891
缺少三个jar包 添加到idea中
使用idea集成开发工具， 使用sparksql对hive数据进行操作报错 Error creating transactional connection factory javax.jdo.JDOF
T_Y_F_的博客
12-20 895
使用idea集成开发工具， 使用sparksql对hive数据进行操作报错 Error creating transactional connection factory javax.jdo.JDOF
Spark shell The specified datastore driver (“com.mysql.jdbc.Driver“) was not found in the CLASSPATH
Aimmon
11-08 646
org.datanucleus.store.rdbms.connectionpool.DatastoreDriverNotFoundException: The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH. Please check your CLASSPATH specification, and the name of the driver.
解决Cause com.mysql.jdbc.exceptions.jdbc4.CommunicationsException
11-09
Cause com.mysql.jdbc.exceptions.jdbc4.CommunicationsException The last packet successfully received from the server was 47,795,922 milliseconds ago. The last packet sent successfully to the server was...
hive-jdbc-uber-2.6.5.0-292.jar
10-10
Class.forName("org.apache.hive.jdbc.HiveDriver"); Connection con = DriverManager.getConnection("jdbc:hive2://localhost:10000/default", "", ""); Statement stmt = con.createStatement(); ResultSet res = ...
hive-jdbc-1.2.1.spark2.jar
04-01
hive-jdbc-1.2.1.spark2.jar
hive驱动包hive-jdbc-uber-2.6.5.0-292.jar（用户客户端连接使用）
06-03
- **Hadoop配置**：Hive JDBC驱动需要知道Hadoop的相关配置，如HDFS的地址、Hive Metastore的地址等，这些信息可能需要通过系统属性或者Hive-site.xml文件提供。 - **安全性**：如果Hive集群启用了Kerberos安全模式...
hive-jdbc-1.2.1-standalone.jar
10-21
dbeaver-cli.exe客户端连接hive所需要的其中一个jar包 hive-jdbc-1.2.1-standalone.jar
大数据系列五：Hive
dustzhu的博客
06-26 2284
一.前言 Hive是建立在Hadoop之上的数据仓库，由Facebook开发，现在是apache顶级开源项目；它依赖于HDFS存储数据，依赖MR处理数据；不完全支持SQL标准，其事务支持，索引，子查询和连接操作也存在很多限制，新版本已经支持update,但效率不高； Hive主要由三个模块： 1.用户接口模块，含CLI、HWI、JDBC、Thrift Server 。 2.驱动模块(Driver)，含编译器、优化器、执行器等 。 3.元数据存储模块(Metastore)，是一个独立的关系型数据库，通常与M
sparksql启动报错The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH
qq_34382453的博客
12-27 990
  要启动sparksql并访问到Hive，有两个步骤： 1、将$HIVE_HOME/conf/hive-site.xml拷贝到$SPARK_HOME/conf下 2、配置MySQL驱动包，将MySQL驱动包放在一个自定义目录下，在$SPARK_HOME/conf里面的spark-defaults.conf配置两个参数 spark.executor.extraClassPath /home/had...
启动hive报错org.datanucleus.exceptions.NucleusException:Error creating transactional connecCtion factory
哇咔咔哇咔的博客
12-26 953
启动hive报错org.datanucleus.exceptions.NucleusException:Error creating transactional connecCtion factory
使用spark.sql运行任务出现See the nested exceptionorg.datanucleus.exceptions.NucleusException: Error creatin
最新发布
ryse1461的博客
12-27 661
经过查找网上没有给出明确的解决方法，均是模糊不清。不过也有道友出现类似的情况，通过日志定位到问题所在应为Spark/Jars文件夹下缺少mysql-connector.jar包，从而无法访问Hive的metastore。
hive --service metastore 启动报错
m0_54233757的博客
08-02 5887
Hadoop@masterHive]$2021-10-28153757StartingHiveMetastoreServeratorg.apache.hadoop.hive.metastore.RetryingHMSHandler.(RetryingHMSHandler.java84)atorg.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java93)atorg.
Spark SQL 读取Hive数据报错:The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the C
muyingmiao的专栏
10-14 858
将Hive的配置文件拷贝到Spark中后，启动spark-shell scala> spark.sql("show databases").show 报错如下 org.datanucleus.store.rdbms.connectionpool.DatastoreDriverNotFoundException: The specified datastore driver ("com.mys...
执行spark sql 遇到的问题
TheManOfCoding的博客
06-28 2572
运行环境：用图形更直观点。在 spark cluster 和 yarn cluster 两种方式运行spark sql， 操作hive中的数据，另外，hive 是独立的，可以直接运行hive处理数据。spark sql的程序比较好写，直接看spark的example的例子HiveFromSpark ，很容易理解首先，在spark cluster上运行：将hive的   hive-site.xml ...
启动hiveThe specified datastore driver (com.mysql.jdbc.Driver) was not found in the CLASSPATH
01-02 6084
在进行hive-1.1.0-cdh5.7.0 的编译安装的时候再启动hive的时候出现下面的异常信息： [hadoop@zydatahadoop001 conf]$ hive which: no hbase in (/usr/java/jdk1.8.0_45/bin:/opt/software/hive/bin:/opt/software/hadoop-cdh/sbin:/opt/softw...
记一次hive建表报错
激进的蜗牛
11-22 1981
执行create table table_name xxx as select xxx的语句 语句如下 create table table1 STORED as ORC TBLPROPERTIES ('orc.compress'='SNAPPY') as select field1 as `名字1`, field2 as `名字2`, from table2 报错如下 Query I...
hive初始化报错org.apache.hadoop.hive.metastore.HiveMetaException: Failed to get schema version.
12-05
根据提供的引用内容，可以看出这两个错误都与Hive的元数据存储有关。第一个错误提示无法实例化SessionHiveMetaStoreClient，可能是由于Hive元数据存储的连接问题导致的。而第二个错误提示访问被拒绝，可能是由于Hive元数据存储的权限问题导致的。 解决方法如下： 1. 对于第一个错误，可以尝试检查Hive元数据存储的连接是否正确，例如检查Hive的配置文件hive-site.xml中的hive.metastore.uris参数是否正确配置。 2. 对于第二个错误，可以尝试检查Hive元数据存储的权限是否正确，例如检查Hive元数据存储的用户名和密码是否正确配置。 示例代码如下： ```shell # 检查Hive配置文件中的hive.metastore.uris参数是否正确配置 cat hive-site.xml | grep hive.metastore.uris # 检查Hive元数据存储的用户名和密码是否正确配置 cat hive-site.xml | grep javax.jdo.option.ConnectionUserName cat hive-site.xml | grep javax.jdo.option.ConnectionPassword ```

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

数据源的港湾

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付：¥1
获取中
扫码支付

您的余额不足，请更换扫码支付或充值

打赏作者

实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值