2024-09-11 20:33:59.421 INFO <mysqltohive2 - 表输出> [E:\JAVA_CODE\spoon\kettle_ktr\mysqltohive2.ktr] 完成处理 (I=0, O=1, R=2, W=0, U=0, E=1)
2024-09-11 20:33:59.427 ERROR <mysqltohive2 - 表输出> [E:\JAVA_CODE\spoon\kettle_ktr\mysqltohive2.ktr] 错误被检测到!
2024-09-11 20:33:59.427 ERROR <mysqltohive2 - 表输出> [E:\JAVA_CODE\spoon\kettle_ktr\mysqltohive2.ktr] 错误被检测到!
2024-09-11 20:33:59.440 ERROR <mysqltohive2 - 表输出> [E:\JAVA_CODE\spoon\kettle_ktr\mysqltohive2.ktr] 错误被检测到!
2024-09-11 20:33:59.451 WARN <mysqltohive2 - 表输出> [E:\JAVA_CODE\spoon\kettle_ktr\mysqltohive2.ktr] 转换被检测
2024-09-11 20:33:59.451 WARN <mysqltohive2 - 表输出> [E:\JAVA_CODE\spoon\kettle_ktr\mysqltohive2.ktr] 转换正在杀死其他步骤!
2024-09-11 20:36:34.361 INFO <Thread-103> [E:\JAVA_CODE\spoon\kettle_ktr\mysqltohive2.ktr] 为了转换解除补丁开始 [mysqltohive2]
2024-09-11 20:36:34.456 INFO <mysqltohive2 - 表输入> [E:\JAVA_CODE\spoon\kettle_ktr\mysqltohive2.ktr] Finished reading query, closing connection.
2024-09-11 20:36:34.458 INFO <mysqltohive2 - 表输入> [E:\JAVA_CODE\spoon\kettle_ktr\mysqltohive2.ktr] 完成处理 (I=14, O=0, R=0, W=14, U=0, E=0)
2024-09-11 20:36:38.837 ERROR <mysqltohive2 - 插入 / 更新> [E:\JAVA_CODE\spoon\kettle_ktr\mysqltohive2.ktr] Error in step, asking everyone to stop because of:
2024-09-11 20:36:38.838 ERROR <mysqltohive2 - 插入 / 更新> [E:\JAVA_CODE\spoon\kettle_ktr\mysqltohive2.ktr] org.pentaho.di.core.exception.KettleDatabaseException:
Error inserting/updating row
Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.StatsTask
at org.pentaho.di.core.database.Database.insertRow(Database.java:1331)
at org.pentaho.di.core.database.Database.insertRow(Database.java:1255)
at org.pentaho.di.core.database.Database.insertRow(Database.java:1243)
at org.pentaho.di.core.database.Database.insertRow(Database.java:1231)
at org.pentaho.di.trans.steps.insertupdate.InsertUpdate.lookupValues(InsertUpdate.java:114)
at org.pentaho.di.trans.steps.insertupdate.InsertUpdate.processRow(InsertUpdate.java:299)
at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
at java.lang.Thread.run(Thread.java:750)
Caused by: java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.StatsTask
at org.apache.hive.jdbc.HiveStatement.waitForOperationToComplete(HiveStatement.java:401)
at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:266)
at org.apache.hive.jdbc.HiveStatement.executeUpdate(HiveStatement.java:511)
at org.apache.hive.jdbc.HivePreparedStatement.executeUpdate(HivePreparedStatement.java:122)
at org.pentaho.di.core.database.Database.insertRow(Database.java:1298)
... 7 more
解决方案
set hive.stats.column.autogather=false;
具体场景
在使用kettle将mysql中的数据导入hive中时,会报该错误,数据可以插入,但是只有两条。
此时需要在hive的conf路径下创建一个.hiverc文件,将上面的语句追加进文件即可。
原帖
hive报错——FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.StatsTask-CSDN博客