hadoop-实践error

error1

在没有配置conf/*-site.xml之前还能运行的很好。配置成功了以后就出错

mjiang@venus ~/program/program/hadoop/install/hadoop-0.20.203.0 $ hadoop jar hadoop-examples-0.20.203.0.jar wordcount input/ out1
11/11/29 12:11:35 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:9000. Already tried 0 time(s).
11/11/29 12:11:36 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:9000. Already tried 1 time(s).
11/11/29 12:11:37 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:9000. Already tried 2 time(s).
11/11/29 12:11:38 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:9000. Already tried 3 time(s).
11/11/29 12:11:39 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:9000. Already tried 4 time(s).
11/11/29 12:11:40 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:9000. Already tried 5 time(s).
11/11/29 12:11:41 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:9000. Already tried 6 time(s).
11/11/29 12:11:42 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:9000. Already tried 7 time(s).
11/11/29 12:11:43 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:9000. Already tried 8 time(s).
11/11/29 12:11:44 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:9000. Already tried 9 time(s).
java.net.ConnectException: Call to localhost/127.0.0.1:9000 failed on connection exception: java.net.ConnectException: Connection refused

同样：

hadoop fs -ls /

－－－>

原来是conf/core-site.xml ...不能解析/etc/hosts 的

#127.0.0.1  venus.uestc.edu.cn  venus   localhost
#::1        venus.uestc.edu.cn  venus   localhost

它将venus解析成127.0.0.1。

所以

1：将配置文件中的hosts全部改成IP

或：屏蔽掉 /etc/hosts的

#127.0.0.1  venus.uestc.edu.cn  venus   localhost
#::1        venus.uestc.edu.cn  venus   localhost

－－－>

一定要重新布置分布

即要运行

bin/stop-all.sh
bin/hadoop namenode - format
bin/start-all.sh

－－－>

可以通过查看/var/hadoop-mjiang-datanode-venus.log里的信息查看失败原因

hadoop程序一直在那，不出结果

mjiang@venus ~/java/eclipse/target-hadoop/Target $ hadoop jar ~/hadoop-1.0.0/hadoop-examples-1.0.0.jar wordcount  fp.txt  output

jps木有datanode 但是 hadoop fs -lsr / 正常

重新开启

hadoop程序一直在那，不出结果

mjiang@venus ~/java/eclipse/target-hadoop/Target $ hadoop jar ~/hadoop-1.0.0/hadoop-examples-1.0.0.jar wordcount  fp.txt  output

jps木有datanode 但是 hadoop fs -lsr / 正常

重新开启

error2

hadoop程序一直在那，不出结果

mjiang@venus ~/java/eclipse/target-hadoop/Target $ hadoop jar ~/hadoop-1.0.0/hadoop-examples-1.0.0.jar wordcount  fp.txt  output

jps木有datanode 但是 hadoop fs -lsr / 正常,不知道什么原因

重新开启，OK