【hive】pentaho无法查询hive

最新推荐文章于 2024-01-15 19:25:51 发布
最新推荐文章于 2024-01-15 19:25:51 发布
阅读量3.1k 收藏
点赞数
分类专栏： Hive
I using table input step in that I am using Hadoop Hive connection type to connect to hadoop database. i am able to see table list but after selecting table I am unable to fetch fields from table and hence unable to preview rows. Getting error as below: 


2012/04/03 18:20:32 - Spoon - Logging goes to  file:///C:/Users/SHAILE~1/AppData/Local/Temp/spoon_996f4d4d-7d8b-11e1-b06e-85d398504852.log 
2012/04/03 18:20:36 - Version checker - OK 
2012/04/03 18:20:36 - class org.pentaho.agilebi.platform.JettyServer - WebServer.Log.CreateListener localhost:10001 
2012/04/03 18:20:38 - Spoon - Asking for repository 
2012/04/03 18:23:42 - Spoon - The transformation has finished!! 
2012/04/03 18:45:23 - C:\Users\shailendrav\Desktop\A.ktr : A - Dispatching started for transformation [C:\Users\shailendrav\Desktop\A.ktr : A] 
2012/04/03 18:45:25 - hive - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : ERROR executing query: org.pentaho.di.core.exception.KettleDatabaseException: 
2012/04/03 18:45:25 - hive - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : Error getting row information from database: 
2012/04/03 18:45:25 - hive - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : Method not supported 
2012/04/03 18:45:25 - hive - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : ERROR in part: openQuery : get rowinfo 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : Unexpected error 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : org.pentaho.di.core.exception.KettleDatabaseException: 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : An error occurred executing SQL in part [openQuery : get rowinfo]: 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : SELECT * 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : FROM currency 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : Error getting row information from database: 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : Method not supported 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : at org.pentaho.di.core.database.Database.openQuery(Database.java:1918) 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : at org.pentaho.di.trans.steps.tableinput.TableInput.doQuery(TableInput.java:223) 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : at org.pentaho.di.trans.steps.tableinput.TableInput.processRow(TableInput.java:133) 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : at org.pentaho.di.trans.step.RunThread.run(RunThread.java:40) 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : at java.lang.Thread.run(Unknown Source) 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : Caused by: org.pentaho.di.core.exception.KettleDatabaseException: 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : Error getting row information from database: 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : Method not supported 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : at org.pentaho.di.core.database.Database.getRowInfo(Database.java:2444) 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : at org.pentaho.di.core.database.Database.openQuery(Database.java:1905) 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : ... 4 more 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : Caused by: java.sql.SQLException: Method not supported 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : at org.apache.hadoop.hive.jdbc.HiveResultSetMetaData.isSigned(HiveResultSetMetaData.java:275) 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : at org.pentaho.di.core.database.Database.getValueFromSQLType(Database.java:2456) 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : at org.pentaho.di.core.database.Database.getRowInfo(Database.java:2437) 
2012/04/03 18:45:25 - Table input.0 - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : ... 5 more 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : Something went wrong while trying to stop the transformation: org.pentaho.di.core.exception.KettleDatabaseException: 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : Error cancelling statement 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : Method not supported 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : org.pentaho.di.core.exception.KettleDatabaseException: 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : Error cancelling statement 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : Method not supported 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : at org.pentaho.di.core.database.Database.cancelStatement(Database.java:639) 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : at org.pentaho.di.core.database.Database.cancelQuery(Database.java:619) 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : at org.pentaho.di.trans.steps.tableinput.TableInput.stopRunning(TableInput.java:293) 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : at org.pentaho.di.trans.Trans.stopAll(Trans.java:1352) 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : at org.pentaho.di.trans.step.BaseStep.stopAll(BaseStep.java:2244) 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : at org.pentaho.di.trans.step.RunThread.run(RunThread.java:64) 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : at java.lang.Thread.run(Unknown Source) 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : Caused by: java.sql.SQLException: Method not supported 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : at org.apache.hadoop.hive.jdbc.HiveStatement.cancel(HiveStatement.java:83) 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : at org.pentaho.di.core.database.Database.cancelStatement(Database.java:633) 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - ERROR (version 4.2.1-GA, build 15926 from 2011-10-19 15.36.47 by buildguy) : ... 6 more 
2012/04/03 18:45:25 - Table input.0 - Finished reading query, closing connection. 
2012/04/03 18:45:25 - Table input.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=1) 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - C:\Users\shailendrav\Desktop\A.ktr : A 
2012/04/03 18:45:25 - C:\Users\shailendrav\Desktop\A.ktr : A - C:\Users\shailendrav\Desktop\A.ktr : A

Attachments

  1. hive connection details.jpg
    206 kB
    04/Apr/12 6:59 AM
  2. hive error.jpg
    196 kB
    04/Apr/12 6:57 AM
  3. no list of tables.jpg
    187 kB
    04/Apr/12 9:11 AM
  4. no list of tables.jpg
    187 kB
    04/Apr/12 9:10 AM
  5. sql output.jpg
    177 kB
    04/Apr/12 9:13 AM

Activity

Doug Moran added a comment -  03/Apr/12 9:27 AM -  edited
I believe that this was fixed and will be in the 4.3 release in a 2 weeks. Can you please try out the latest build and verify that it works for you. 

Download the CE build from CI here: 
http://ci.pentaho.com/view/Data%20Integration/job/pentaho-big-data-plugin/lastSuccessfulBuild/artifact/pentaho-big-data-plugin/dist/pdi-ce-4.3.0-SNAPSHOT-big-data.zip 

Thanks, 
Doug 
shailendra vichare added a comment -  04/Apr/12 1:09 AM
Hi Doug, 

Thanks for your quick reply. 

Regards, 
Shailendra.
shailendra vichare added a comment -  04/Apr/12 6:57 AM -  edited
Hi Doug, 

I have tried latest build for connecting to Hive database with the help of table input step. Still I am not able to fetch the fields in SQL and hence data from Hive database. I have attached screenshot of error. 

Please help. 

Thanks, 
Shailendra.
shailendra vichare added a comment -  04/Apr/12 7:50 AM
Hi Doug, 

Is this issue related to Hive JDBC drivers? At present I am using HIVE 0.5 JDBC driver. 

Thanks, 
Shailendra.
shailendra vichare added a comment -  04/Apr/12 9:18 AM
Hi Doug, 

Above issue is resolved by using HIVE 0.7.0 JDBC driver with Pentaho 4.3 version. 
But now I am getting following error with this version. 

1) After selecting generate SQL, I am unable to get list of tables eventhough tables are present. Please refer attachment with 'no list of tables' title. 
2) To get data I am writing SQL as 
    "FROM currency s 
     SELECT s.currencycode, s.name, s.modifieddate" 
but getting all the values in first column and not in separate columns as shown in attachment 'sql output'. 

Please help. 

Thanks, 
Shailendra. 
 
Doug Moran added a comment -  14/Jun/12 3:59 PM
Shailendra,
Sorry I missed your reply.

Your query is not standard SQL, perhaps it is fooling the parser into thinking it's doing a sub select.

Try:
SELECT s.currencycode, s.name, s.modifieddate
FROM currency s
Matey Dzhigoshev added a comment -  29/Jun/12 10:41 AM

Hi All, 

I use hive-jdbc-0.7.1-cdh3u4.jar with Pentaho 4.3.0 Developer release, but it not work for me. I receive same error as it describe above. 

Please help, 

Thanks, 
Mat 

Jordan Ganoff added a comment -  11/Jul/12 2:01 PM
Hi Mat, 

Please make sure you're using the Pentaho Hive JDBC Driver that ships with PDI 4.3.0. It contains required fixes we rely on. You can obtain PDI 4.3.0 from  http://sourceforge.net/projects/pentaho/files/Data%20Integration/4.3.0-stable/. 

If you just need the JDBC driver you can try using the latest JDBC build from our continuous integration environment. Here's a link to our driver that is now compatible with Hive 0.7.0 - 0.9.0 (and likely 0.9.x):  http://ci.pentaho.com/job/apache-hive/lastSuccessfulBuild/artifact/jdbc/dist/hive-jdbc-0.7.0-pentaho-SNAPSHOT.jar 

Thanks, 
Jordan
Doug Moran added a comment -  01/Aug/12 2:02 PM
Please test this after the Hadoop distro shim layer work ( PDI-8044)
Carter Everett added a comment -  31/Aug/12 12:50 PM
validated
「已注销」
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 1
    评论
专栏目录
（Hive输出）pentaho-big-data-kettle-plugins-hive-6.1.0.1-196
07-24
（Hive输出）ETLDesigner\common\system\karaf\system\pentaho\pentaho-big-data-kettle-plugins-hive\6.1.0.1-196\下的文件。 （Hive输出）pentaho-big-data-kettle-plugins-hive-6.1.0.1-196。
Table space access is not allowed
wangxinzhen的专栏
02-03 5153
访问数据库报错如下： com.ibm.db2.jcc.am.SqlException: Table space access is not allowed.. SQLCODE=-290, SQLSTATE=55039，DRIVER=3.72.52; 解决方案： 根据错误描述确定问题原因为表空间不可访问， 1）首先查看表空间状态： 执行db2 list tablespaces命令，查看表空间状态。 查看各表空间的状态(State)，若表空间状态不为0x0000，表明该表空间有问题。 数据库的异常
“text.insert(END, ‘{}‘.format(‘下载完成！！！‘)“报‘,‘ or ‘)‘ expected小问题
m0_50027019的博客
09-02 1102
** text.insert(END, ‘{}’.format(‘1111’) **报',' or ')' expected小问题** ** 事实很简单，就是最后少加了一个’)’，，，，，然而我全部的代码都是从ide上复制过去的，所以没有怀疑是少了 这里，这段话写得挺好，哈哈(直接翻译出来的，还行) ...
解决：Error 1406 (22001): Data too long for column
weixin_45945976的博客
01-15 493
【代码】解决：Error 1406 (22001): Data too long for column
Linux服务器运行kettle转换报错：Driver class 'org.gjt.mm.mysql.Driver' could not be found
进击的Coder菜鸟
07-15 1万+
报错关键字： 2019/07/10 17:01:12 - user_identity_card表输入.0 - org.gjt.mm.mysql.Driver 2019/07/10 17:01:12 - 插入 / 更新.0 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) :...
Error while commiting the transaction
C C++ VC
07-12 1593
SSH2+JPA，提示如下错误： Stacktraces org.springframework.transaction.TransactionSystemException: Could not commit JPA transaction; nested exception is javax.persistence.RollbackException: Error while comm
错误连接数据库 [fad] : org.pentaho.di.core.exception.KettleDatabaseException: Error occurred while trying
bro_man的博客
07-02 1011
一、数据库名称不对，用户和密码输入不对，如是这种情况，则需要仔细检查输入是否正确。二、环境没有配置话，也会出现这种情况 需要下载Java的jdk，下载链接。在kettle中如果出现这种情况，可能是有以下几种情况，希望对大家有所帮助。
kettle运行报错 org.pentaho.di.core.exception.KettleException: 一个数据库错误
热门推荐
weixin_45305977的博客
12-24 1万+
目录欢迎使用Markdown编辑器 欢迎使用Markdown编辑器 你好！ 这是你第一次使用 Markdown编辑器 所展示的欢迎页。如果你想学习如何使用Markdown编辑器, 可以仔细阅读这篇文章，了解一下Markdown的基本语法知识。 ...
记录Kettle连接Oracle [Oracle1] : org.pentaho.di.core.exception.KettleDatabaseException: Error occurred
sunzeyongh的博客
09-12 1943
[Oracle1] : org.pentaho.di.core.exception.KettleDatabaseException: Error occurred while trying to connect to the database Error connecting to database: (using class oracle.jdbc.driver.OracleDriver) IO 错误: The Network Adapter could not establish the conne
pentaho-aggdesigner-algorithm-5.1.5-jhyde.zip
02-23
org / pentaho / pentaho-aggdesigner-algorithm / 5.1.5-jhyde / pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar，解决maven引入hive的jar包时依赖报错Could not find artifact org.pentaho:pentaho-aggdesigner-...
Kettle将数据导入导Hive2
01-07
 本来将数据导入到hive，但是不知道什么原因太慢了，一小时200条数据，优化一波kettle，还是成效不大，因此改为借用hadoop file output 到hdfs，然后再load 到hive表里 一，正文 1.在转换里拖入big data/hadoop ...
pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar.zip
01-05
解决maven引入hive的jar包时依赖报错Could not find artifact org.pentaho:pentaho-aggdesigner-algorithm:pom:5.1.5-jhyde in xxx的问题，maven路径org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho...
hive-jdbc-0.7.0-pentaho-1.0.2.jar解决kettle取hive数据乱码
12-21
使用kettle抽取hive中的数据时，遇到了取数结果乱码的问题。替换此包可以解决
实验-三、数据库安全性(目的、要求和模板).doc
04-24
实验-三、数据库安全性(目的、要求和模板).doc
基于Docker搭建K8s集群离线包
04-24
基于Docker搭建K8s集群离线包，包含部署时所需的全部文件，可在内网环境中使用，K8s为1.23.0版本，docker为20.10.9-3版本
基于springboot+vue实现的求职招聘类型网站源代码+数据库（优质毕设项目）.zip
最新发布
04-24
基于springboot+vue实现的求职招聘类型网站源代码+数据库（优质毕设项目）.zip个人经导师指导并认可通过的98分毕业设计项目，主要针对计算机相关专业的正在做毕设的学生和需要项目实战练习的学习者。也可作为课程设计、期末大作业。包含全部项目源码、该项目可以直接作为毕设使用。项目都经过严格调试，确保可以运行！ 基于springboot+vue实现的求职招聘类型网站源代码+数据库（优质毕设项目）.zip个人经导师指导并认可通过的98分毕业设计项目，主要针对计算机相关专业的正在做毕设的学生和需要项目实战练习的学习者。也可作为课程设计、期末大作业。包含全部项目源码、该项目可以直接作为毕设使用。项目都经过严格调试，确保可以运行！ 基于springboot+vue实现的求职招聘类型网站源代码+数据库（优质毕设项目）.zip个人经导师指导并认可通过的98分毕业设计项目，主要针对计算机相关专业的正在做毕设的学生和需要项目实战练习的学习者。也可作为课程设计、期末大作业。包含全部项目源码、该项目可以直接作为毕设使用。项目都经过严格调试，确保可以运行！基于springboot+vue实现的求
基于Android系统Api封装常用工具类.zip
04-24
基于Android系统Api封装常用工具类.zip
kettle 8.2 hive
09-09
Hive 是一个基于 Hadoop 的数据仓库基础架构，它提供了一种类似于 SQL 的查询语言，称为 HiveQL，用于在大规模数据集上执行分析查询。Hive 可以利用 Hadoop 的分布式处理能力，并且适用于处理结构化和半结构化数据。...

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论 1
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值