hive ，sqoop使用的jdbc驱动版本（mysql-connector-java-5.1.23-bin.jar）影响hive使用

最新推荐文章于 2022-10-04 17:46:05 发布
最新推荐文章于 2022-10-04 17:46:05 发布
阅读量7.2k 收藏
点赞数
分类专栏： hadoop
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/lili72/article/details/26092367
版权 
 2014-04-01 04:16:57,190 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
2014-04-01 04:16:57,190 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
2014-04-01 04:16:57,194 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
2014-04-01 04:16:57,194 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
2014-04-01 04:16:57,194 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
2014-04-01 04:16:57,194 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
2014-04-01 04:17:00,432 ERROR exec.Task (SessionState.java:printError(400)) - Failed with exception Iteration request failed : SELECT `A0`.`BUCKET_COL_NAME`,`A0`.`INTEGER_IDX` AS NUCORDER0 FROM `BUCKETING_COLS` `A0` WHERE `A0`.`SD_ID` = ? AND `A0`.`INTEGER_IDX` >= 0 ORDER BY NUCORDER0
Iteration request failed : SELECT `A0`.`BUCKET_COL_NAME`,`A0`.`INTEGER_IDX` AS NUCORDER0 FROM `BUCKETING_COLS` `A0` WHERE `A0`.`SD_ID` = ? AND `A0`.`INTEGER_IDX` >= 0 ORDER BY NUCORDER0
org.datanucleus.exceptions.NucleusDataStoreException: Iteration request failed : SELECT `A0`.`BUCKET_COL_NAME`,`A0`.`INTEGER_IDX` AS NUCORDER0 FROM `BUCKETING_COLS` `A0` WHERE `A0`.`SD_ID` = ? AND `A0`.`INTEGER_IDX` >= 0 ORDER BY NUCORDER0
	at org.datanucleus.store.rdbms.scostore.RDBMSJoinListStore.listIterator(RDBMSJoinListStore.java:189)
	at org.datanucleus.store.mapped.scostore.AbstractListStore.listIterator(AbstractListStore.java:84)
	at org.datanucleus.store.mapped.scostore.AbstractListStore.iterator(AbstractListStore.java:74)
	at org.datanucleus.sco.backed.List.loadFromStore(List.java:241)
	at org.datanucleus.sco.backed.List.equals(List.java:393)
	at org.datanucleus.jdo.state.JDOStateManagerImpl.setObjectField(JDOStateManagerImpl.java:2456)
	at org.apache.hadoop.hive.metastore.model.MStorageDescriptor.jdoSetbucketCols(MStorageDescriptor.java)
	at org.apache.hadoop.hive.metastore.model.MStorageDescriptor.setBucketCols(MStorageDescriptor.java:120)
	at org.apache.hadoop.hive.metastore.ObjectStore.copyMSD(ObjectStore.java:1954)
	at org.apache.hadoop.hive.metastore.ObjectStore.fullCopyMSD(ObjectStore.java:1971)
	at org.apache.hadoop.hive.metastore.ObjectStore.alterTable(ObjectStore.java:1852)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hive.metastore.RetryingRawStore.invoke(RetryingRawStore.java:111)
	at com.sun.proxy.$Proxy5.alterTable(Unknown Source)
	at org.apache.hadoop.hive.metastore.HiveAlterHandler.alterTable(HiveAlterHandler.java:182)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_table(HiveMetaStore.java:1609)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.alter_table(HiveMetaStoreClient.java:174)
	at org.apache.hadoop.hive.ql.metadata.Hive.alterTable(Hive.java:375)
	at org.apache.hadoop.hive.ql.metadata.Hive.loadTable(Hive.java:1266)
	at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:234)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:134)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
	at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1326)
	at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1118)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:951)
	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:258)
	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:215)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:406)
	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:689)
	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:557)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'OPTION SQL_SELECT_LIMIT=DEFAULT' at line 1
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
	at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
	at com.mysql.jdbc.Util.getInstance(Util.java:386)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1052)
	at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3609)
	at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3541)
	at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2002)
	at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2163)
	at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2618)
	at com.mysql.jdbc.StatementImpl.executeSimpleNonQuery(StatementImpl.java:1644)
	at com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:2277)
	at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96)
	at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96)
	at org.datanucleus.store.rdbms.SQLController.executeStatementQuery(SQLController.java:457)
	at org.datanucleus.store.rdbms.scostore.RDBMSJoinListStore.listIterator(RDBMSJoinListStore.java:152)
	... 37 more
Nested Throwables StackTrace:
com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'OPTION SQL_SELECT_LIMIT=DEFAULT' at line 1
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
	at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
	at com.mysql.jdbc.Util.getInstance(Util.java:386)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1052)
	at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3609)
	at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3541)
	at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2002)
	at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2163)
	at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2618)
	at com.mysql.jdbc.StatementImpl.executeSimpleNonQuery(StatementImpl.java:1644)
	at com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:2277)
	at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96)
	at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96)
	at org.datanucleus.store.rdbms.SQLController.executeStatementQuery(SQLController.java:457)
	at org.datanucleus.store.rdbms.scostore.RDBMSJoinListStore.listIterator(RDBMSJoinListStore.java:152)
	at org.datanucleus.store.mapped.scostore.AbstractListStore.listIterator(AbstractListStore.java:84)
	at org.datanucleus.store.mapped.scostore.AbstractListStore.iterator(AbstractListStore.java:74)
	at org.datanucleus.sco.backed.List.loadFromStore(List.java:241)
	at org.datanucleus.sco.backed.List.equals(List.java:393)
	at org.datanucleus.jdo.state.JDOStateManagerImpl.setObjectField(JDOStateManagerImpl.java:2456)
	at org.apache.hadoop.hive.metastore.model.MStorageDescriptor.jdoSetbucketCols(MStorageDescriptor.java)
	at org.apache.hadoop.hive.metastore.model.MStorageDescriptor.setBucketCols(MStorageDescriptor.java:120)
	at org.apache.hadoop.hive.metastore.ObjectStore.copyMSD(ObjectStore.java:1954)
	at org.apache.hadoop.hive.metastore.ObjectStore.fullCopyMSD(ObjectStore.java:1971)
	at org.apache.hadoop.hive.metastore.ObjectStore.alterTable(ObjectStore.java:1852)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hive.metastore.RetryingRawStore.invoke(RetryingRawStore.java:111)
	at com.sun.proxy.$Proxy5.alterTable(Unknown Source)
	at org.apache.hadoop.hive.metastore.HiveAlterHandler.alterTable(HiveAlterHandler.java:182)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_table(HiveMetaStore.java:1609)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.alter_table(HiveMetaStoreClient.java:174)
	at org.apache.hadoop.hive.ql.metadata.Hive.alterTable(Hive.java:375)
	at org.apache.hadoop.hive.ql.metadata.Hive.loadTable(Hive.java:1266)
	at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:234)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:134)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
	at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1326)
	at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1118)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:951)
	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:258)
	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:215)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:406)
	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:689)
	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:557)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:156)


2014-04-01 04:17:00,433 ERROR ql.Driver (SessionState.java:printError(400)) - FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

查看hive运行日志
在/tmp/root/hive.log   
发现时驱动版本太低，

后来换成 mysql-connector-java-5.1.23-bin.jar

不在报错。

li72li72
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
centos下hive连接mysql驱动 ，mysql-connector-java-8.0.26-1.el7.noarch.
07-29
centos 下hive连接mysql驱动 ，mysql-connector-java-8.0.26-1.el7.noarch. 使用方法： 1.下载本rpm文件后，上传至你的服务器（虚拟机） 2. rpm -ivh mysql-connector-java-8.0.26-1.el7.noarch进行安装 3.安装完成...
hive jdbc驱动_JDBC连接hive和impala驱动问题
weixin_39638086的博客
12-01 2092
最近在试用JAVA去访问hive ,impala服务(我使用的cloudera-manager版本是CDH5.1*.**)发现一个奇怪的问题，不管hive还是impala，jdbc的驱动都是jdbc:hive2开头，而且依赖都是 org.apache.hive hive-jdbc ${hive.version}这让我产生了疑问，我到底连的是hive还是impala?经过一番折腾，...
hadoop安装之-sqoop
南山行者
11-16 1276
一、安装准备 1， 下载sqoop包 http://mirrors.hust.edu.cn/apache/         sqoop分为1.4和1.9版本，1.9版本为交互版本，即服务器端、客户端，1.4为工具版本，直接运行即可，1.4版本根据hadoop版本来区别，本例使用2.6版本的haddop，所以安装时，选择sqoop-1.4.6.bin__hadoop-2.0.4-alpha.ta
大数据技术之Hive
anglemanyi的博客
10-04 1380
Hive是建立在Hadoop上的数据仓库基础架构，它提供一系列的工具，可以进行数据提取、转化、加载（ETL）Hive定义了简单的类SQL查询语言，成为HQL,它允许熟悉SQL的用户直接查询Hadoop中的数据Hive包含SQL解析引擎，它会将SQL语句转译成MR Job，然后再hadoop中执行第二种方式工作中更常用(95%)方式1： load data .... partition方式2： 创建目录，上传数据，绑定已有的数据到指定分区。
hive -show databases报错，Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStore
周君的个人博客
08-03 2533
问题一： 刚配置完mysql作为hive的元数据库，成功启动hive后，执行命令show databases; 报错。 hive> show databases; FAILED: SemanticException org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException...
【hive】hive表很大的时候查询报错问题
anyi365416的专栏
10-18 1281
　　线上hive使用环境出现了一个奇怪的问题，跑一段时间就报如下错误： FAILED: SemanticException MetaException(message:Exception thrown when executing query : SELECT A0.PART_NAME,A0.PART_NAME AS NUCORDER0 FROM PARTITIONS A0 LEFT ...
数据转换工具sqoop安装和使用
FLY的博客
06-14 1260
Sqoop sqoop1.4.7 sqoop安装 sqoop使用 sqoop导入导出数据
hive驱动包hive-jdbc-uber-2.6.5.0-292.jar（用户客户端连接使用）
06-03
dbeaver连接hive时需要的驱动包hive-jdbc-uber-2.6.5.0-292.jar
apache-hive-3.1.2+mysql-connector-java-5.1.32-bin.jar
09-26
mysql-connector-java-5.1.32-bin.jar apache-hive-3.1.2-bin.tar.gz 及安装说明
hive-jdbc-uber-2.6.5.0-292.jar驱动
01-05
hive-jdbc-uber-2.6.5.0-292.jar驱动
sqoop jdbc驱动包
08-26
sqoop 导入数据时候报错ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not load db driver class: oracle.jdbc.OracleDriver 缺少驱动包。
sqoop需要导入的包
10-26
时候用sqoop需要导入的包 mysql-connector-java-5.1.45.jar，json -to-sqoop.jar
sqoop-hadoop的jar包
01-15
jdbc的SqlServer驱动包sqljdbc_2.0.1803.100_chs.exe和sqoop-sqlserver-1.0.tar.gz，使用sqljdbc时双击sqljdbc_2.0.1803.100_chs.exe即可解压得到相应的jar包，全部免积分下载，共同学习
hive-1.1.0-cdh5.14.2.tar.gz和mysql-connector-java-5.1.38.jar连接包
06-26
hive-1.1.0-cdh5.14.2.tar.gz和mysql-connector-java-5.1.38.jar连接包
第四次实验：安装配置sqoop-1.4.6并与mySQL连接
pedfcba的博客
01-10 1130
sqoop是SQL to Hadoop的简称，按照字面理解就是一个传统数据库与hadoop之间迁移数据的工具，配置起来跟掐面的大同小异，希望以后处理数据的时候树莓派的小身板能撑住w如果不行就再买一台协同作业好了（啥   0、运行环境 操作系统：Linux raspberrypi 4.1.7+ 安装位置:/mnt/study Hadoop版本：1.0.4 mySQL版本：5.5.46 JDK版本：1
sqoop相关整理记录
热门推荐
数据服务中心，数据平台，数据开发
11-07 1万+
生产背景： 在从mysql导入到hive中,遇到如下问题：  1） 源mysql和集群机器不在同一个网段中，导致执行导入命令，网络连接失败。  2） 某些字符导入到hive中，出现报错终止。      2.1  sqoop使用的JDBC-connector 版本太低（更换版本）。 从hive导出到mysql中，遇到如下问题：  1）某些字符插入mysql，出现报错终止。    1.1
nginx安装配置记录
数据服务中心，数据平台，数据开发
01-31 7151
文章出处：http://blog.csdn.net/lili72 环境cenos5.9 安装在192.168.119.131上进行.安装路径统一为/home/bigdata/   1 安装之前需要先安装：    1.1 openssl    1.1.1 下载 ,cd /home/bigdata/   wget  http://www.openssl.org/source/openssl-
hadoop平台读取文件报错
数据服务中心，数据平台，数据开发
12-08 6149
背景： 生产环境有个脚本执行读取st层表数据时出现IO错误，查看表目录下的文件，都是压缩后的文件。详细信息如下： Task with the most failures(4): ----- Task ID: task_201408301703_172845_m_003505 URL: http://master:50030/taskdetails.jsp?jobid=j
（6） 将mysql驱动程序mysql-connector-java-5.1.47.jar、 mysql-connector-java-5.1.47-bin.jar包拷贝到Hive安装目录lib文件夹中
最新发布
06-07
sudo cp mysql-connector-java-5.1.47-bin.jar /opt/your_name/apache-hive-x.x.x-bin/lib/ ``` 将 `your_name` 替换为你的姓名，将 `x.x.x` 替换为 Hive 的版本号即可。 3. 使用以下命令重新加载 Hive 的配置...

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值