Hadoop集群环境搭建中一个错误的解决方案

本文转自我的ChinaUnix博客： http://blog.chinaunix.net/u3/107162/showart_2204785.html

 

     

环境已经搭好并可以启动了，如下：

1. maohong@maohong-desktop:~/Software/Development/Hadoop/hadoop-0.20.2$ bin/start-all.sh
2. starting namenode, logging to /home/maohong/Software/Development/Hadoop/hadoop-0.20.2/bin/../logs/hadoop-maohong-namenode-maohong-desktop.out
3. slave1: starting datanode, logging to /home/maohong/Software/Development/Hadoop/hadoop-0.20.2/bin/../logs/hadoop-maohong-datanode-debian.out
4. slave2: starting datanode, logging to /home/maohong/Software/Development/Hadoop/hadoop-0.20.2/bin/../logs/hadoop-maohong-datanode-node2.out
5. master: starting datanode, logging to /home/maohong/Software/Development/Hadoop/hadoop-0.20.2/bin/../logs/hadoop-maohong-datanode-maohong-desktop.out
6. master: starting secondarynamenode, logging to /home/maohong/Software/Development/Hadoop/hadoop-0.20.2/bin/../logs/hadoop-maohong-secondarynamenode-maohong-desktop.out
7. starting jobtracker, logging to /home/maohong/Software/Development/Hadoop/hadoop-0.20.2/bin/../logs/hadoop-maohong-jobtracker-maohong-desktop.out
8. slave1: starting tasktracker, logging to /home/maohong/Software/Development/Hadoop/hadoop-0.20.2/bin/../logs/hadoop-maohong-tasktracker-debian.out
9. slave2: starting tasktracker, logging to /home/maohong/Software/Development/Hadoop/hadoop-0.20.2/bin/../logs/hadoop-maohong-tasktracker-node2.out
10. master: starting tasktracker, logging to /home/maohong/Software/Development/Hadoop/hadoop-0.20.2/bin/../logs/hadoop-maohong-tasktracker-maohong-desktop.out
11. maohong@maohong-desktop:~/Software/Development/Hadoop/hadoop-0.20.2$ jps
12. 22565 SecondaryNameNode
13. 22646 JobTracker
14. 22342 DataNode
15. 22907 Jps
16. 22115 NameNode
17. 22861 TaskTracker

但是执行wordcount程序到时候出现Error: java.lang.NullPointerException 错误如下：

1. maohong@maohong-desktop:~/Software/Development/Hadoop/hadoop-0.20.2$ bin/hadoop jar hadoop-0.20.2-examples.jar wordcount test-in test-out
2. 10/03/25 19:40:05 INFO input.FileInputFormat: Total input paths to process : 4
3. 10/03/25 19:40:05 INFO mapred.JobClient: Running job: job_201003251936_0001
4. 10/03/25 19:40:06 INFO mapred.JobClient:  map 0% reduce 0%
5. 10/03/25 19:40:13 INFO mapred.JobClient:  map 50% reduce 0%
6. 10/03/25 19:40:14 INFO mapred.JobClient:  map 100% reduce 0%
7. 10/03/25 19:40:21 INFO mapred.JobClient: Task Id : attempt_201003251936_0001_r_000000_0, Status : FAILED
8. Error: java.lang.NullPointerException
9.         at java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:768)
10.         at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$GetMapEventsThread.getMapCompletionEvents(ReduceTask.java:2683)
11.         at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$GetMapEventsThread.run(ReduceTa