启动hiveThe specified datastore driver (com.mysql.jdbc.Driver) was not found in the CLASSPATH

最新推荐文章于 2024-07-19 15:31:28 发布
最新推荐文章于 2024-07-19 15:31:28 发布
阅读量6.1k 收藏 4
点赞数 2
分类专栏： Hadoop hive 文章标签： 异常 hadoop hive com-mysql-jdbc-driver
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/yu0_zhang0/article/details/78957050
版权
Hadoop 同时被 2 个专栏收录
44 篇文章 3 订阅
订阅专栏
hive
15 篇文章 8 订阅
订阅专栏
在进行hive-1.1.0-cdh5.7.0 的编译安装的时候再启动hive的时候出现下面的异常信息：
[hadoop@zydatahadoop001 conf]$ hive
which: no hbase in (/usr/java/jdk1.8.0_45/bin:/opt/software/hive/bin:/opt/software/hadoop-cdh/sbin:/opt/software/hadoop-cdh/bin:/opt/software/findbugs-1.3.9/bin:/usr/local/protobuf/bin:/opt/software/apache-maven-3.3.9/bin:/usr/java/jdk1.8.0_45/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin)

Logging initialized using configuration in jar:file:/opt/software/hive-1.1.0-cdh5.7.0/lib/hive-common-1.1.0-cdh5.7.0.jar!/hive-log4j.properties
Exception in thread "main" java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
        at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:539)
        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:687)
        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:626)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
        at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1492)
        at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:67)
        at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:82)
        at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2935)
        at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2954)
        at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:512)
        ... 8 more
Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
        at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1490)
        ... 13 more
Caused by: javax.jdo.JDOFatalInternalException: Error creating transactional connection factory
NestedThrowables:
java.lang.reflect.InvocationTargetException
        at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:587)
        at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:788)
        at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:333)
        at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:202)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at javax.jdo.JDOHelper$16.run(JDOHelper.java:1965)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.jdo.JDOHelper.invoke(JDOHelper.java:1960)
        at javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1166)
        at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:808)
        at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:701)
        at org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:410)
        at org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:439)
        at org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:334)
        at org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:290)
        at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:73)
        at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
        at org.apache.hadoop.hive.metastore.RawStoreProxy.<init>(RawStoreProxy.java:57)
        at org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:66)
        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:642)
        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:620)
        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:673)
        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:478)
        at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:78)
        at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84)
        at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5891)
        at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:198)
        at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:74)
        ... 18 more
Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
        at org.datanucleus.plugin.NonManagedPluginRegistry.createExecutableExtension(NonManagedPluginRegistry.java:631)
        at org.datanucleus.plugin.PluginManager.createExecutableExtension(PluginManager.java:325)
        at org.datanucleus.store.AbstractStoreManager.registerConnectionFactory(AbstractStoreManager.java:282)
        at org.datanucleus.store.AbstractStoreManager.<init>(AbstractStoreManager.java:240)
        at org.datanucleus.store.rdbms.RDBMSStoreManager.<init>(RDBMSStoreManager.java:286)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
        at org.datanucleus.plugin.NonManagedPluginRegistry.createExecutableExtension(NonManagedPluginRegistry.java:631)
        at org.datanucleus.plugin.PluginManager.createExecutableExtension(PluginManager.java:301)
        at org.datanucleus.NucleusContext.createStoreManagerForProperties(NucleusContext.java:1187)
        at org.datanucleus.NucleusContext.initialise(NucleusContext.java:356)
        at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:775)
        ... 47 more
(问题所在，找不到mysql驱动)
Caused by: org.datanucleus.exceptions.NucleusException: Attempt to invoke the "BONECP" plugin to create a ConnectionPool gave an error : The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH. Please check your CLASSPATH specification, and the name of the driver.
        at org.datanucleus.store.rdbms.ConnectionFactoryImpl.generateDataSources(ConnectionFactoryImpl.java:259)
        at org.datanucleus.store.rdbms.ConnectionFactoryImpl.initialiseDataSources(ConnectionFactoryImpl.java:131)
        at org.datanucleus.store.rdbms.ConnectionFactoryImpl.<init>(ConnectionFactoryImpl.java:85)
        ... 65 more
Caused by: org.datanucleus.store.rdbms.connectionpool.DatastoreDriverNotFoundException: The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH. Please check your CLASSPATH specification, and the name of the driver.
        at org.datanucleus.store.rdbms.connectionpool.AbstractConnectionPoolFactory.loadDriver(AbstractConnectionPoolFactory.java:58)
        at org.datanucleus.store.rdbms.connectionpool.BoneCPConnectionPoolFactory.createConnectionPool(BoneCPConnectionPoolFactory.java:54)
        at org.datanucleus.store.rdbms.ConnectionFactoryImpl.generateDataSources(ConnectionFactoryImpl.java:238)
        ... 67 more

错误的原因：在lib目录下找不到mysql驱动包。

  • 解决办法：到官网下载mysql驱动下载地址
    把下载好的压缩包（mysql-connector-java-5.1.45.zip）进行解压
解压：
unzip mysql-connector-java-5.1.45.zip
  • 将mysql-connector-java-5.1.45-bin.jar复制到lib下
cp mysql-connector-java-5.1.45/mysql-connector-java-5.1.45-bin.jar lib
爆发的~小宇宙
关注
专栏目录
hive The specified datastore driver (“com.mysql.jdbc.Driver“) was not found
九师兄
07-04 4098
1.项目 2.环境搭建 必看:https://blog.csdn.net/qq_21383435/article/details/80598613 3.运行环境 hadoop lcc@lcc hadoop$ jps 1329 RunJar 545 1219 RunJar 980 SecondaryNameNode 1093 ResourceManager 791 NameNo...
The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH
weixin_43616627的博客
01-13 3897
The specified datastore driver (“com.mysql.jdbc.Driver”) was not found in the CLASSPATH. Please check your CLASSPATH specification, and the name of the driver已解决 要执行的代码如下： object HiveRead { def mai...
运行Spark SQL报The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH.
博客
10-31 2808
想启动spark-sql，结果报了 Caused by: org.datanucleus.store.rdbms.connectionpool.DatastoreDriverNotFoundException: The specified datastore driver (“com.mysql.jdbc.Driver”) was not found in the CLASSPATH. Pleas...
Hive 的 classpath 简介
最新发布
goTsHgo的博客
07-19 684
Hive的classpath是Hive运行时用于查找所需类和资源文件的路径集合。它包含了Hive运行所需的所有JAR文件和配置文件的位置。理解和管理Hive的classpath对于确保Hive正常运行、添加自定义库或解决类加载问题非常重要。了解和正确配置Hive的classpath对于解决依赖问题、添加自定义功能和优化性能都很重要。在进行任何修改时，建议先在测试环境中验证，以确保不会影响生产环境的。
【报错解决】The specified datastore driver (“com.mysql.jdbc.Driver “) was not found in the CLASSPATH. Plea
邵奈一的博客
03-19 4083
今天打开了好多年没有用的大数据虚拟机集群，发现了一些莫名其妙的问题，比如我用 spark-shell ，竟然报错了： Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ... Caused by: java.lang.reflect.InvocationTargetException ... Caused by:
Hive学习2_错误： The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH
wang_zhenwei的博客
01-22 8256
在启动Hive时，报错： The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH 详细描述见一篇英文文档。 I'm trying to install Apache Hive, I insert HIVE_HOME and HADOOP_HOME into hi
Spark SQL 读取Hive数据报错:The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the C
muyingmiao的专栏
10-14 884
将Hive的配置文件拷贝到Spark中后，启动spark-shell scala> spark.sql("show databases").show 报错如下 org.datanucleus.store.rdbms.connectionpool.DatastoreDriverNotFoundException: The specified datastore driver ("com.mys...
org.datanucleus.store.rdbms.connectionpool.DatastoreDriverNotFoundException: The specified datastore driver ("com.mysql.cj.jdbc.Driver") was not found in the CLASSPATH. Please check your CLASSPATH specification, and the name of the driver.
06-06
这个错误提示说明在你的CLASSPATH中没有找到名为"com.mysql.cj.jdbc.Driver"的MySQL数据库驱动程序。 要解决这个问题，你可以尝试以下步骤： 1. 确认你的CLASSPATH中是否包含了正确的MySQL数据库驱动程序。你可以...
报错：The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH. Please c...
weixin_30776273的博客
05-08 572
报错背景： CDH中集成hive插件，启动报错。 报错现象： [main]: Metastore Thrift Server threw an exception... javax.jdo.JDOFatalInternalException: Error creating transactional connection factory at org.datanucleu...
Spark shell The specified datastore driver (“com.mysql.jdbc.Driver“) was not found in the CLASSPATH
Aimmon
11-08 681
org.datanucleus.store.rdbms.connectionpool.DatastoreDriverNotFoundException: The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH. Please check your CLASSPATH specification, and the name of the driver.
Hive踩坑之The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH，找不到驱动
liuhehe123的博客
02-26 6310
在mysql中创建hive数据库，并允许hive接入 mysql&gt; create database hive; #这个hive数据库与hive-site.xml中localhost:3306/hive的hive对应，用来保存hive元数据 mysql&gt; grant all on *.* to hive@localhost identified by 'hive'; #将所...
Spark连接Hive时报错The specified datastore driver (“com.mysql.jdbc.Driver“) was not found in the CLASSPAT
weixin_39876938的博客
09-06 370
Spark连接Hive时报错The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPAT
Hive metastore启动报错The specified datastore driver(“com.mysql.jdbc.Driver“) was not found in the CLASS
数据源的港湾
11-04 1272
现象 某集群有两个Hive metastore，其中一个正常运行，另一个启动报错，报错的Hive metastore日志报错信息如下， 上午9点56:55.875分 WARN HiveMetaStore [main]: Retrying creating default database after error: Error creating transactional connection factory javax.jdo.JDOFatalInternalException: Error creati
Spark SQL报错：The specified datastore driver (“com.mysql.jdbc.Driver“) was not found in the CLASSPATH.
zhengzaifeidelushang的博客
08-13 850
Spark SQL报错：The specified datastore driver (“com.mysql.jdbc.Driver”) was not found in the CLASSPATH. 启动Spark SQL报错： ./spark-sql Caused by: org.datanucleus.exceptions.NucleusException: Attempt to invoke the "BONECP" plugin to create a ConnectionPool gave
sparksql启动报错The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH
qq_34382453的博客
12-27 1017
  要启动sparksql并访问到Hive，有两个步骤： 1、将$HIVE_HOME/conf/hive-site.xml拷贝到$SPARK_HOME/conf下 2、配置MySQL驱动包，将MySQL驱动包放在一个自定义目录下，在$SPARK_HOME/conf里面的spark-defaults.conf配置两个参数 spark.executor.extraClassPath /home/had...
spark-shell在yarn上卖弄启动时报错The specified datastore driver (“com.mysql.jdbc.Driver“) was not found
new_buff_007的博客
07-03 268
在安装好的Hadoop集群和spark集群中安装好hive。但是在利用yarn启动spark-shell时候，报了以下错误： The specified datastore driver ("com.mysql.jdbc.Driver") was not found 。。。。。 这个时候与找不到了MySQL的驱动，所以需要在spark-defaults.conf中进行指定配置。 spark.executor.extraClassPath /home/hadoop/jars/mysql-con
Kylin 构建Cube报错(“com.mysql.jdbc.Driver“) was not found in the CLASSPATH
fox_233的博客
02-07 346
Kylin 构建Cube报错("com.mysql.jdbc.Driver") was not found in the CLASSPATH
hive挂mysql的时候报错：jdbc driver can't be found
weixin_33816946的博客
12-13 226
需要手工拷贝 mysql-connector-java-5.1.7-bin.jar 以下目录下 /usr/share/cmf/lib/usr/lib/sqoop/lib/usr/lib/hive/lib 转载于:https://blog.51cto.com/13240596/2050398
评论 5
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值