Hadoop
JHC_binge
励志专业IT开发
展开
-
hadoop出现WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using.
/usr/local/hadoop/lib/native/hadoop-env.sh添加export HADOOP_OPTS="-Djava.library.path=${HADOOP}/lib/native"原创 2018-10-19 11:13:49 · 3902 阅读 · 0 评论 -
主节点nameNode启动,数据节点dataNode崩溃
原因:是没有执行hdfs nameNode -format 初始化解决:把hadoop_tmp目录下的文件都删除,执行命令hdfs nameNode -format 初始化即可,如图即成功了原创 2018-12-12 20:02:59 · 294 阅读 · 0 评论 -
Hadoop服务启动出现Permission denied (publickey,password).
办法:需要设置免密连接登录原创 2018-11-27 14:08:32 · 2875 阅读 · 0 评论 -
Exception in thread "main" java.lang.RuntimeException: com.ctc.wstx.exc.WstxParsingException: Illega
把3230行的注释掉即可:原创 2018-11-30 14:28:57 · 12038 阅读 · 0 评论 -
hadoop-functions.sh: line 398: syntax error near unexpected token
需要先:hdfs namenode -format 要不然获取不到值有可能也是要直接 start-all.sh启动不能 sh start-all.sh启动原创 2018-10-30 19:39:18 · 3361 阅读 · 0 评论 -
Hadoop执行WordCount 报Unable to initialize MapOutputCollector org.apache.hadoop.mapred.MapTask
Unable to initialize MapOutputCollector org.apache.hadoop.mapred.MapTask$MapOutputBuffer原因:Text应该用:import org.apache.hadoop.io.Text;而不是用:import com.sun.jersey.core.impl.provider.entity.XMLJA...原创 2018-10-19 18:52:44 · 540 阅读 · 0 评论 -
Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 10582
Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 10582 at com.thoughtworks.paranamer.BytecodeReadingParanamer$ClassReader.accept(BytecodeReadingParanamer.java:563) at com....原创 2018-12-20 19:05:36 · 5728 阅读 · 5 评论