hadoop
大跃ET
大数据,数据仓库,每周要看一个spark小模块或小问题
展开
-
如何配置Hadoop的 Secondary节点 & NameNode节点失效恢复
第一部分: 如何设置Secondary NameNode节点(单独的) 1. 在masters文件中添加 Secondary节点的主机名。 2. 修改hdfs-default.xml 文件 dfs.http.address client148.hado转载 2012-12-31 16:32:32 · 2245 阅读 · 0 评论 -
1.hadoop3: mkdir: cannot create directory `/usr/local/hadoop/bin/../logs': Permission denied
1.hadoop3: mkdir: cannot create directory `/usr/local/hadoop/bin/../logs': Permission denied把所有Datanode节点执行下面命令[hadoop@hadoop3 local]$ chown -R hadoop:hadoop hadoop-0.20.2/转载 2012-12-30 00:16:08 · 7581 阅读 · 0 评论 -
hadoop常见错误-hadoop cannot assign requested address
hadoop cannot assign requested address:解决方法:namenode与JobTrack分开部署后,在namenode端启动hadoop时报错: Caused by: java.net.BindException: Cannot assign requested address 找了很久也没找到原因,最后发现是自己理解上的错误 分开部署后其实是转载 2012-12-30 00:41:28 · 3433 阅读 · 1 评论 -
hadoop常见异常---ncompatible namespaceIDs
2010-07-21 10:12:11,987 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: Incompatible namespaceIDs in /home/admin/joe.wangh/hadoop/data/dfs.data.dir: namenode namespaceID =转载 2012-12-30 02:09:50 · 982 阅读 · 0 评论 -
hadoop常见问题 -localhost: Error: JAVA_HOME is not set
localhost: Error: JAVA_HOME is not set.启动start-all.sh时出现如下错误:root@ubuntu:/home/chenwq/hadoop/hadoop-0.21.0/bin# start-all.shThis script is Deprecated. Instead use start-dfs.sh and start-mapred.sh转载 2012-12-26 23:14:12 · 4423 阅读 · 0 评论