问题记录
文章平均质量分 86
花沐人
qq:1215754067
有问题联系
展开
-
There are 2 missing blocks. The following files may be corrupted
项目场景:集群断电重启块丢失,50070页面报错:There are 2 missing blocks. The following files may be corrupted问题描述:There are 2 missing blocks. The following files may be corrupted 解决方案:1.哪一个文件的数据块丢失了:hdfs fsck / -list-corruptfileblocks2.删除数据块信息: hdfs fsck 路径 -delete原创 2020-12-07 18:36:26 · 1841 阅读 · 0 评论 -
There appears to be a gap in the edit log. We expected txid 867311, but got txid 867402.
项目场景:集群断电之后重启集群,namenode启动失败,去hadoop安装目录差看日志/hadoop/logs 发现There appears to be a gap in the edit log. We expected txid 867311, but got txid 867402.问题描述:down standby NN.java.io.IOException: There appears to be a gap in the edit log. We expected txi原创 2020-12-07 18:34:10 · 844 阅读 · 3 评论 -
process information unavailable
项目场景:– process information unavailable解决方案:cd /tmprm -rf hsperfdata_*原创 2020-12-07 18:31:13 · 216 阅读 · 0 评论 -
Journal Storage Directory /tmp/hadoop/dfs/journalnode/ns not formatted
Journal Storage Directory /tmp/hadoop/dfs/journalnode/ns not formatted项目场景:项目背景:大数据集群断电关机,强制关机,非正常关机,没有关闭服务关机造成的问题:Journal Storage Directory /tmp/hadoop/dfs/journalnode/ns not formatted报错:2020-12-07 15:02:47,704 INFO org.apache.hadoop.hdfs.qjournal.cl原创 2020-12-07 18:30:03 · 1764 阅读 · 2 评论 -
Exception in thread “main“ java.lang.NoClassDefFoundError: org/python/core/PyObject
idea Exception in thread "main" java.lang.NoClassDefFoundError: org/python/core/PyObject报错原因:maven xml配置文件修改:修改成这样的就会生成2个jar包,把大的jar包传到linux上运行 就可以解决 java.lang.NoClassDefFoundError: org/python/core/PyObject报错SLF4J: Class path contains multiple SLF4J原创 2020-12-01 11:05:00 · 1354 阅读 · 0 评论 -
FAILED: HiveException java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.me
文章目录问题背景:版本问题原因:mysql出现问题导致hive报错解决办法:FAILED: HiveException java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient问题背景:版本JDK:1.8.0_141hive:3.1.0mysql:8.0.20问题原因:mysql出现问题导致hive报错解决办法:https原创 2020-08-10 22:31:48 · 1603 阅读 · 0 评论 -
Can‘t connect to local MySQL server through socket ‘/var/lib/mysql/mysql.sock‘ (111)
文章目录问题背景:版本问题原因:集群断电,mysql启动不起来解决办法:三步骤Can’t connect to local MySQL server through socket ‘/var/lib/mysql/mysql.sock’ (111)问题背景:版本mysql:8.0.20JDK:1.8.0_141问题原因:集群断电,mysql启动不起来解决办法:三步骤删掉mysql.sockcd /var/lib/mysqlrm -rf mysql.sock给mysql添加权限ch原创 2020-08-10 22:26:04 · 1492 阅读 · 6 评论 -
ERROR:java.lang.RuntimeException: java.lang.ClassNotFoundException: Class cn.itcast.xx.xx not found
文章目录Error: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class cn.itcast.mapreduce.WordCountMapper not found问题背景:版本问题原因:找不到类,主程序中缺少配置解决办法:job.setJarByClass(JobMain.class);Error: java.lang.RuntimeException: java.lang.ClassNotFoundException:原创 2020-07-06 15:11:48 · 3349 阅读 · 5 评论 -
idea 打包 报错maven-shade-plugin:2.4.3:shade (default) on project xxx : Error creating shaded jar: null
idea 打包 报错maven-shade-plugin:2.4.3:shade (default) on project xxx : Error creating shaded jar: null背景:idea版本:ideaIU-2020.1.2JDK:1.8.0_141maven版本:3.6.3原因:maven-shade-plugin的版本太低<plugin> <groupId>org.apache.maven.plugins&l原创 2020-07-06 14:26:59 · 6112 阅读 · 4 评论 -
idea 打包package 的时候警告:Discovered module-info.class. Shading will break its strong encapsulation.
idea 打包package 的时候警告:Discovered module-info.class. Shading will break its strong encapsulation.问题背景:idea版本:ideaIU-2020.1.2JDK:1.8.0_141maven版本:3.6.3maven-shade-plugin:3.2.1<?xml version="1.0" encoding="UTF-8"?><project xmlns="http://maven原创 2020-07-06 14:15:30 · 5483 阅读 · 0 评论