大数据排错指南
# 无伤大雅 #
不管多么痛苦,都不要逃往轻松的一边;
如果只能做到一件事的话,就将其登峰造极。
集中一点,登峰造极。
——我妻善逸
展开
-
Could not load org.apache.hadoop.hive.conf.HiveConf. Make sure HIVE_CONF_DIR
Sqoop导入mysql表中的数据到hive,出现如下错误:ERROR hive.HiveConfig: Could not load org.apache.hadoop.hive.conf.HiveConf. Make sure HIVE_CONF_DIR is set correctly.解决办法:# vim /etc/profileexport HADOOP_CLASSPATH=$HADOOP_CLASSPATH:$HIVE_HOME/lib/*# source /etc/profile原创 2021-07-23 15:31:50 · 370 阅读 · 0 评论 -
java.lang.NoSuchMethodError: org.apache.hadoop.hive.ql.session.SessionState
java.lang.NoSuchMethodError:org.apache.hadoop.hive.ql.session.SessionStateExecution Error, return code -101 from org.apache.hadoop.hive.ql.exec.mr.MapRedTaskjava.lang.NoSuchMethodError: org.apache.hadoop.hive.ql.session.SessionState.getPerfLogger()Lorg/原创 2021-07-15 21:20:31 · 1076 阅读 · 1 评论 -
2021-07-15
Yarn 任务问题描述yarn 任务执行提示成功,但任务退出,且报上述错误解决办法为yarn 分配更多内存: --driver-memory 512M原创 2021-07-15 16:39:19 · 83 阅读 · 0 评论 -
User class threw exception:org.apache.spark.sql.streaming
hudi整合hive提交到yarn报错User class threw exception: org.apache.spark.sql.streaming.StreamingQueryException: Following instants have timestamps >= compactionInstant (20210710211157) Instants :[[20210713205004__deltacommit__COMPLETED], [20210713205200__deltac原创 2021-07-14 15:03:43 · 840 阅读 · 0 评论