hive ，sqoop使用的jdbc驱动版本（mysql-connector-java-5.1.23-bin.jar）影响hive使用

最新推荐文章于 2024-08-31 12:02:40 发布
最新推荐文章于 2024-08-31 12:02:40 发布
阅读量7.3k 收藏
点赞数
分类专栏： hadoop
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/lili72/article/details/26092367
版权 
 2014-04-01 04:16:57,190 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
2014-04-01 04:16:57,190 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
2014-04-01 04:16:57,194 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
2014-04-01 04:16:57,194 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
2014-04-01 04:16:57,194 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
2014-04-01 04:16:57,194 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
2014-04-01 04:17:00,432 ERROR exec.Task (SessionState.java:printError(400)) - Failed with exception Iteration request failed : SELECT `A0`.`BUCKET_COL_NAME`,`A0`.`INTEGER_IDX` AS NUCORDER0 FROM `BUCKETING_COLS` `A0` WHERE `A0`.`SD_ID` = ? AND `A0`.`INTEGER_IDX` >= 0 ORDER BY NUCORDER0
Iteration request failed : SELECT `A0`.`BUCKET_COL_NAME`,`A0`.`INTEGER_IDX` AS NUCORDER0 FROM `BUCKETING_COLS` `A0` WHERE `A0`.`SD_ID` = ? AND `A0`.`INTEGER_IDX` >= 0 ORDER BY NUCORDER0
org.datanucleus.exceptions.NucleusDataStoreException: Iteration request failed : SELECT `A0`.`BUCKET_COL_NAME`,`A0`.`INTEGER_IDX` AS NUCORDER0 FROM `BUCKETING_COLS` `A0` WHERE `A0`.`SD_ID` = ? AND `A0`.`INTEGER_IDX` >= 0 ORDER BY NUCORDER0
	at org.datanucleus.store.rdbms.scostore.RDBMSJoinListStore.listIterator(RDBMSJoinListStore.java:189)
	at org.datanucleus.store.mapped.scostore.AbstractListStore.listIterator(AbstractListStore.java:84)
	at org.datanucleus.store.mapped.scostore.AbstractListStore.iterator(AbstractListStore.java:74)
	at org.datanucleus.sco.backed.List.loadFromStore(List.java:241)
	at org.datanucleus.sco.backed.List.equals(List.java:393)
	at org.datanucleus.jdo.state.JDOStateManagerImpl.setObjectField(JDOStateManagerImpl.java:2456)
	at org.apache.hadoop.hive.metastore.model.MStorageDescriptor.jdoSetbucketCols(MStorageDescriptor.java)
	at org.apache.hadoop.hive.metastore.model.MStorageDescriptor.setBucketCols(MStorageDescriptor.java:120)
	at org.apache.hadoop.hive.metastore.ObjectStore.copyMSD(ObjectStore.java:1954)
	at org.apache.hadoop.hive.metastore.ObjectStore.fullCopyMSD(ObjectStore.java:1971)
	at org.apache.hadoop.hive.metastore.ObjectStore.alterTable(ObjectStore.java:1852)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hive.metastore.RetryingRawStore.invoke(RetryingRawStore.java:111)
	at com.sun.proxy.$Proxy5.alterTable(Unknown Source)
	at org.apache.hadoop.hive.metastore.HiveAlterHandler.alterTable(HiveAlterHandler.java:182)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_table(HiveMetaStore.java:1609)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.alter_table(HiveMetaStoreClient.java:174)
	at org.apache.hadoop.hive.ql.metadata.Hive.alterTable(Hive.java:375)
	at org.apache.hadoop.hive.ql.metadata.Hive.loadTable(Hive.java:1266)
	at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:234)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:134)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
	at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1326)
	at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1118)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:951)
	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:258)
	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:215)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:406)
	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:689)
	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:557)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'OPTION SQL_SELECT_LIMIT=DEFAULT' at line 1
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
	at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
	at com.mysql.jdbc.Util.getInstance(Util.java:386)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1052)
	at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3609)
	at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3541)
	at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2002)
	at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2163)
	at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2618)
	at com.mysql.jdbc.StatementImpl.executeSimpleNonQuery(StatementImpl.java:1644)
	at com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:2277)
	at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96)
	at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96)
	at org.datanucleus.store.rdbms.SQLController.executeStatementQuery(SQLController.java:457)
	at org.datanucleus.store.rdbms.scostore.RDBMSJoinListStore.listIterator(RDBMSJoinListStore.java:152)
	... 37 more
Nested Throwables StackTrace:
com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'OPTION SQL_SELECT_LIMIT=DEFAULT' at line 1
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
	at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
	at com.mysql.jdbc.Util.getInstance(Util.java:386)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1052)
	at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3609)
	at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3541)
	at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2002)
	at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2163)
	at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2618)
	at com.mysql.jdbc.StatementImpl.executeSimpleNonQuery(StatementImpl.java:1644)
	at com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:2277)
	at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96)
	at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96)
	at org.datanucleus.store.rdbms.SQLController.executeStatementQuery(SQLController.java:457)
	at org.datanucleus.store.rdbms.scostore.RDBMSJoinListStore.listIterator(RDBMSJoinListStore.java:152)
	at org.datanucleus.store.mapped.scostore.AbstractListStore.listIterator(AbstractListStore.java:84)
	at org.datanucleus.store.mapped.scostore.AbstractListStore.iterator(AbstractListStore.java:74)
	at org.datanucleus.sco.backed.List.loadFromStore(List.java:241)
	at org.datanucleus.sco.backed.List.equals(List.java:393)
	at org.datanucleus.jdo.state.JDOStateManagerImpl.setObjectField(JDOStateManagerImpl.java:2456)
	at org.apache.hadoop.hive.metastore.model.MStorageDescriptor.jdoSetbucketCols(MStorageDescriptor.java)
	at org.apache.hadoop.hive.metastore.model.MStorageDescriptor.setBucketCols(MStorageDescriptor.java:120)
	at org.apache.hadoop.hive.metastore.ObjectStore.copyMSD(ObjectStore.java:1954)
	at org.apache.hadoop.hive.metastore.ObjectStore.fullCopyMSD(ObjectStore.java:1971)
	at org.apache.hadoop.hive.metastore.ObjectStore.alterTable(ObjectStore.java:1852)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hive.metastore.RetryingRawStore.invoke(RetryingRawStore.java:111)
	at com.sun.proxy.$Proxy5.alterTable(Unknown Source)
	at org.apache.hadoop.hive.metastore.HiveAlterHandler.alterTable(HiveAlterHandler.java:182)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_table(HiveMetaStore.java:1609)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.alter_table(HiveMetaStoreClient.java:174)
	at org.apache.hadoop.hive.ql.metadata.Hive.alterTable(Hive.java:375)
	at org.apache.hadoop.hive.ql.metadata.Hive.loadTable(Hive.java:1266)
	at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:234)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:134)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
	at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1326)
	at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1118)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:951)
	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:258)
	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:215)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:406)
	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:689)
	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:557)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:156)


2014-04-01 04:17:00,433 ERROR ql.Driver (SessionState.java:printError(400)) - FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

查看hive运行日志
在/tmp/root/hive.log   
发现时驱动版本太低，

后来换成 mysql-connector-java-5.1.23-bin.jar

不在报错。

第四次实验：安装配置sqoop-1.4.6并与mySQL连接
pedfcba的博客
01-10 1154
sqoop是SQL to Hadoop的简称，按照字面理解就是一个传统数据库与hadoop之间迁移数据的工具，配置起来跟掐面的大同小异，希望以后处理数据的时候树莓派的小身板能撑住w如果不行就再买一台协同作业好了（啥   0、运行环境 操作系统：Linux raspberrypi 4.1.7+ 安装位置:/mnt/study Hadoop版本：1.0.4 mySQL版本：5.5.46 JDK版本：1
centos下hive连接mysql驱动 ，mysql-connector-java-8.0.26-1.el7.noarch.
07-29
centos 下hive连接mysql驱动 ，mysql-connector-java-8.0.26-1.el7.noarch. 使用方法： 1.下载本rpm文件后，上传至你的服务器（虚拟机） 2. rpm -ivh mysql-connector-java-8.0.26-1.el7.noarch进行安装 3.安装完成...
sqoop jdbc驱动包
08-26
sqoop 导入数据时候报错ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not load db driver class: oracle.jdbc.OracleDriver 缺少驱动包。
sqoop 1.x 整合mysql jdbc
u012842247的专栏
01-04 376
1、安装成功后，需要整合mysql 进行数据的读取。 [root@hadoop01 lib]# cp mysql-connector-java-8.0.17.jar /data/bigData/sqoop/sqoop-1.4.7/lib/ 2、进行测试：sqoop Warning: /data/bigData/sqoop/sqoop-1.4.7/../accumulo does not...
为什么 mysql-connector-java 只需要在 runtime 作用范围中配置
最新发布
weixin_54574094的博客
08-31 555
在 Java 中，访问数据库通常依赖于 JDBC（Java Database Connectivity）技术。JDBC 定义了一套标准的 API，用于与数据库进行交互。为了访问数据库，我们编写的代码需要依赖于 JDBC 接口而不是具体的数据库实现（如 MySQL JDBC 驱动）。在这篇博客中，我们将展示如何使用 JDBC 接口来访问数据库，同时解释如何在 Maven 中配置这些依赖。
sqoop 导入数据导出数据jdbc找不到或者版本问题
xuyingzhong的博客
03-28 1286
sqoop jdbc.jar 放入三个目录下 /opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/lib/sqoop/jdcb.jar /opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/lib/sqoop/lib/jdcb.jar /usr/local/j...
JDBC之数据库连接池(十三)
zzq的博客
02-19 199
数据库连接池的概述
hive驱动包hive-jdbc-uber-2.6.5.0-292.jar（用户客户端连接使用）
06-03
标题中的"**hive-jdbc-uber-2.6.5.0-292.jar**"是一个Uber（也称为Shaded）JAR文件，它集成了Hive JDBC驱动的所有依赖项。Uber JAR的目的是为了方便部署，因为它将所有必需的库合并到一个单一的文件中，避免了类路径...
DBeaver链接hive驱动包下载： hive-jdbc-uber-2.6.5.0-292.jar
05-17
《DBeaver与Hive连接：hive-jdbc-uber-2.6.5.0-292.jar驱动详解》 在大数据处理领域，Hive作为一个基于Hadoop的数据仓库工具，广泛用于数据查询和分析。而DBeaver，作为一款跨平台的数据库管理工具，以其用户友好的...
hive-1.1.0-cdh5.14.2.tar.gz和mysql-connector-java-5.1.38.jar连接包
06-26
5. **JDBC连接**: JDBC（Java Database Connectivity）是Java访问数据库的标准API，`mysql-connector-java-5.1.38.jar`是MySQL的JDBC驱动，它使得Hive可以通过JDBC接口与MySQL建立连接，实现数据交换。 6. **Hive与...
mysql-connector-java-8.0.28.tar.gz
03-25
在实际使用中，开发人员需要将`mysql-connector-java-8.0.28.jar`添加到Java项目的类路径（classpath）中，或者在Hive中通过`ADD JAR`命令加载此驱动，以便在Hive查询中使用`CREATE EXTERNAL TABLE`语句连接MySQL...
hive-2.1.1+mysql-connector-java-5.1.46-bin.jar
08-09
MySQL 作为 hive 的元数据库时遇到的问题 Mysql 版本 Ver 14.14 Distrib 5.6.40, for Linux (x86_64) using EditLine wrapper Hive 版本 apache-hive-2.1.1-bin.tar.gz 这个版本用 mysql-connector-java-5.1.46-bin.jar！！！！！
Hive的安装和更为Hive的数据库为MySQL，使用JDBC连接Hive
isea_you's blog
11-30 1507
目录 前言： Hive的安装： 更为Hive的数据库为MySQL： 多窗口测试： HiveJDBC访问： 前言： 首先Hive会将数据存储在HDFS上，Hive的本质是将HQL转化成MapReduce，Hive还需要YARN进行资源调度，所以安装Hive的前提是，你已经搭建好了Hadoop集群，关于Hadoop集群的搭建，请参见下面的这篇文章： 15分钟，搭建Hadoop集群 ...
Sqoop的介绍(导入导出原理)
qichangjian的博客
03-04 6299
1.sqoop的介绍 （1）介绍： Sqoop是Apache旗下的一款“hadoop和关系型数据库服务器之间传送数据”的工具。   导入数据：MySQL、Oracle导入数据到hadoop的hdfs、hive、HBASE等数据存储系统。    导出数据：从hadoop的文件系统中导出数据到关系型数据库中。 （2）工作机制   将导入导出的命令翻译成MapReduce程序来实现，并且MapRedu...
大数据技术之Hive
anglemanyi的博客
10-04 1637
Hive是建立在Hadoop上的数据仓库基础架构，它提供一系列的工具，可以进行数据提取、转化、加载（ETL）Hive定义了简单的类SQL查询语言，成为HQL,它允许熟悉SQL的用户直接查询Hadoop中的数据Hive包含SQL解析引擎，它会将SQL语句转译成MR Job，然后再hadoop中执行第二种方式工作中更常用(95%)方式1： load data .... partition方式2： 创建目录，上传数据，绑定已有的数据到指定分区。
hive -show databases报错，Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStore
周君的个人博客
08-03 2990
问题一： 刚配置完mysql作为hive的元数据库，成功启动hive后，执行命令show databases; 报错。 hive> show databases; FAILED: SemanticException org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException...
查看hive版本-获取hive-jdbc驱动-连接hive报错
qq_39348280的博客
11-24 4916
查看hive版本-获取hive-jdbc驱动-连接hive报错前言一、使用步骤报错示例 前言 链接hive报错大多数都是hive的jdbc驱动版本有问题跟链接的hive版本不一样 一、使用步骤 在hadoop集群，hive 找到jar包路径 退出hive : quit; 进入路径 使用工具导出jar包 报错示例 [ 08S01] Could not open client transport with JDBC Uri: jdbc:hive2://192.168.4.11:10000/d
解决Sqoop将mysql表数据导入到Hive时报错HiveConf和derby driver问题
大头皮鞋的博客
11-29 1466
执行sqoop import 语句将mysql表数据导入到Hive表 $ sqoop import --connect jdbc:mysql://localhost:3306/ua1 --username root --password 123 --table EMP --fields-terminated-by '\t' --num-mappers 1 --hive-database d...
sqoop对接SqlServer,Oracle，mysql数据库
weixin_43530138的博客
06-19 1036
一、安装sqoop: 1、sqoop的解压并配置环境变量： tar -zxvf /bigdata/sqoop-1.4.6-cdh5.13.2.tar.gz -C /apps 配置环境变量： vi /etc/profile export SQOOP_HOME=/apps/sqoop-1.4.6-cdh5.13.2 export PATH=PATH:PATH:PATH:SQOOP_HOME/bin: ...
（6） 将mysql驱动程序mysql-connector-java-5.1.47.jar、 mysql-connector-java-5.1.47-bin.jar包拷贝到Hive安装目录lib文件夹中
06-07
sudo cp mysql-connector-java-5.1.47-bin.jar /opt/your_name/apache-hive-x.x.x-bin/lib/ ``` 将 `your_name` 替换为你的姓名，将 `x.x.x` 替换为 Hive 的版本号即可。 3. 使用以下命令重新加载 Hive 的配置...
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值