sqoop mysql导入hive_使用sqoop从mysql向hive导入数据报错

在尝试使用sqoop将数据从mysql导入到hive时,遇到了`Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient`的错误。错误日志显示与thrift库的版本冲突有关。问题在于不同组件之间的thrift版本不兼容,导致HiveMetaStoreClient无法实例化。尝试更新或统一Hadoop、Hive和相关依赖的thrift版本来解决问题。
摘要由CSDN通过智能技术生成

使用sqoop从mysql向hive导数据时出现出错:Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient

[grid@rhel0 ~]$ sqoop import --connect jdbc:mysql://192.168.122.100:3306/sqoop --username sqoop -P --table demo_blog --hive-import

14/09/26 19:47:25 INFO hive.HiveImport: SLF4J: Found binding in [jar:file:/opt/hadoop-2.4.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]

14/09/26 19:47:25 INFO hive.HiveImport: SLF4J: Found binding in [jar:file:/opt/hbase-0.94.22/lib/slf4j-log4j12-1.4.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]

14/09/26 19:47:25 INFO hive.HiveImport: SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

14/09/26 19:47:25 INFO hive.HiveImport: SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]

14/09/26 19:47:31 INFO hive.HiveImport: Exception in thread "main" java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient

14/09/26 19:47:31 INFO hive.HiveImport:     at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:346)

14/09/26 19:47:31 INFO hive.HiveImport:     at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)

14/09/26 19:47:31 INFO hive.HiveImport:     at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)

14/09/26 19:47:31 INFO hive.HiveImport:     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

14/09/26 19:47:31 INFO hive.HiveImport:     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

14/09/26 19:47:31 INFO hive.HiveImport:     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

14/09/26 19:47:31 INFO hive.HiveImport:     at java.lang.reflect.Method.invoke(Method.java:606)

14/09/26 19:47:31 INFO hive.HiveImport:     at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

14/09/26 19:47:31 INFO hive.HiveImport: Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient

14/09/26 19:47:31 INFO hive.HiveImport:     at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1412)

14/09/26 19:47:31 INFO hive.HiveImport:     at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.(RetryingMetaStoreClient.java:62)

14/09/26 19:47:31 INFO hive.HiveImport:     at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:72)

14/09/26 19:47:31 INFO hive.HiveImport:     at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2453)

14/09/26 19:47:31 INFO hive.HiveImport:     at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2465)

14/09/26 19:47:31 INFO hive.HiveImport:     at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:340)

14/09/26 19:47:31 INFO hive.HiveImport:     ... 7 more

14/09/26 19:47:31 INFO hive.HiveImport: Caused by: java.lang.reflect.InvocationTargetException

14/09/26 19:47:31 INFO hive.HiveImport:     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

14/09/26 19:47:31 INFO hive.HiveImport:     at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)

14/09/26 19:47:31 INFO hive.HiveImport:     at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

14/09/26 19:47:31 INFO hive.HiveImport:     at java.lang.reflect.Constructor.newInstance(Constructor.java:526)

14/09/26 19:47:31 INFO hive.HiveImport:     at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1410)

14/09/26 19:47:31 INFO hive.HiveImport:     ... 12 more

14/09/26 19:47:31 INFO hive.HiveImport: Caused by: java.lang.NoSuchMethodError: org.apache.thrift.EncodingUtils.setBit(BIZ)B

14/09/26 19:47:31 INFO hive.HiveImport:     at org.apache.hadoop.hive.metastore.api.PrivilegeGrantInfo.setCreateTimeIsSet(PrivilegeGrantInfo.java:245)

14/09/26 19:47:31 INFO hive.HiveImport:     at org.apache.hadoop.hive.metastore.api.PrivilegeGrantInfo.(PrivilegeGrantInfo.java:163)

14/09/26 19:47:31 INFO hive.HiveImport:    

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值