![](https://img-blog.csdnimg.cn/20201014180756724.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
hadoop
huangdsky
这个作者很懒,什么都没留下…
展开
-
hdfs namenode -format 报错
21:8485. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)15/08/28 08:52:02 INFO ipc.Client: Retrying connect to server: hcg05/原创 2015-09-02 12:35:25 · 5166 阅读 · 0 评论 -
两个resourcemanager都处于standby,zkfc无法切换resourcemanager
该问题是对yarn-site.xml文件里的内存分配调整造成的,当强制变换yarn-resourcemanager为active报错yarn rmadmin -transitionToActive --forcemanual rm1You have specified the forcemanual flag. This flag is dangerous, as it c原创 2015-10-07 10:13:18 · 5171 阅读 · 0 评论 -
hadoop 错误1 journalnode与namenode超时
2016-06-04 18:27:49,728 INFO org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager: Waited 7002 ms (timeout=20000 ms) for a response for sendEdits. Succeeded so far: [10.80.248.12:8485,10.80.248原创 2016-06-06 11:20:20 · 3120 阅读 · 1 评论 -
hbase 预分区官网例子
public static boolean createTable(HBaseAdmin admin, HTableDescriptor table, byte[][] splits)throws IOException { try { admin.createTable( table, splits ); return true; } catch (TableExist原创 2016-05-23 18:01:03 · 644 阅读 · 0 评论 -
hbase1.2.1 编译hadoop-2.7.2
根目录下MAVEN_OPTS="-Xmx2g" mvn site install assembly:single -Dhadoop-two.version=2.7.2 -DskipTests原创 2016-04-29 13:21:30 · 522 阅读 · 0 评论 -
记录一个map-site.xml -Xmx 1000m 写成了 1000报错问题
http://stackoverflow.com/questions/30231508/yarn-mapreduce-job-dies-with-strange-message原创 2016-03-24 17:32:59 · 734 阅读 · 0 评论 -
运行mahout 将学习集的序列化转化为向量报错Error: Java heap space(mapreduce运行内存调优)
mahout seq2sparse -i email-bydate-train-seq -o email-bydate-train-vector -lnorm -nv -wt tfidf mahout seq2sparse -i email-bydate-train-seq -o email-bydate-train-vector -lnorm -nv -wt tfidfMAHOUT_LO原创 2015-10-23 16:03:06 · 1120 阅读 · 0 评论 -
mahout hadoop2.6.0 编译失败
[DEBUG] Detected Maven Version: 3.3.3 is allowed in the range [3.3.3,).[WARNING] Rule 0: org.apache.maven.plugins.enforcer.RequireJavaVersion failed with message:Detected JDK Version: 1.8.0-51 is原创 2015-10-16 15:55:45 · 1477 阅读 · 0 评论 -
centos 7配置静态IP 后 service network restart 成功 IP仍然保持原来值不变
systemctl -f start NetworkManager原创 2015-09-17 13:17:50 · 6173 阅读 · 0 评论 -
由于加了mahout*.job.jar进hadoop2.X/share/hadoop/common/lib重启datanode闪退报错
org.apache.hadoop.hdfs.server.common.IncorrectVersionException: Unexpected version of storage directory /home/hcg/hadoop/hadoop-2.6.0/mydata/data. Reported: -56. Expecting = -55去掉mahout*.job.j原创 2015-11-04 14:56:56 · 686 阅读 · 0 评论 -
nutch2.3 hadoop2.6.0 hbase0.98.8 分布式爬虫NoClassDefFoundError: org/apache/hadoop/hbase/HBaseConfigurati
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/HBaseConfigurationat org.apache.gora.hbase.store.HBaseStore.initialize(HBaseStore.java:114)at org.apache.gora.sto原创 2015-09-14 17:43:45 · 1384 阅读 · 0 评论 -
hadoop2.6.0下打包mahout调用数据模型程序 运行时报错
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/mahout/common/AbstractJobat java.lang.ClassLoader.defineClass1(Native Method)at java.lang.ClassLoader.defineClass(ClassLoader.原创 2015-11-03 16:52:01 · 990 阅读 · 0 评论 -
zookeeper-3.4.6格式化问题 hdfs zkfc -formatZk报错
感谢朋友的提醒:错误在配置hdfs-site.xml文件原创 2015-08-20 16:57:23 · 18122 阅读 · 5 评论 -
hadoop-2.6.0+zookeper-3.4.6之HA模式两个namenode不同状态active和standby的切换
经过多次的试验控制active和standby的切换的主要线程是 DFSZKFailoverController1.原来状态namenode1:active ;namenode2:standby 2.当某种原因致使namenode1失效时,重启namenode1后状态变为:namenode2:active ;namenode1:standby3.如果要恢复原有状态namenode1:a原创 2015-09-02 11:18:23 · 2099 阅读 · 0 评论 -
hbase0.94.14+hadoop2.6.0
一Hbase的HMaster闪退报错日志:2015-08-22 10:19:45,537 FATAL [master-hcg01,60000,1440209981755] master.HMaster: Unhandled exception. Starting shutdown.java.lang.UnsupportedOperationException: Not implemente原创 2015-08-22 12:12:14 · 618 阅读 · 0 评论 -
修改linux打开文件最大数与最大线程数
修改 /etc/security/limits.d/90-nproc.conf 将1024变为65525原创 2016-08-01 14:25:29 · 519 阅读 · 0 评论