一、准备工作
启动hadoop(如有疑问见上篇博文),jps查看进程:
hadoop@h1:~$ jps
3395 SecondaryNameNode
5222 Jps
3177 NameNode
4394 JobHistoryServer
3565 ResourceManager
二、进行测试
1、建立输入文件:echo "My first hadoop example. Hello Hadoop in input. " > input
2、在hadoop上建立目录: hdfs dfs -mkdir -p /user/hadoop
查看建立的目录,
hadoop@h1:~$ hdfs dfs -ls /user
Found 1 items
drwxr-xr-x - hadoop supergroup 0 2015-03-22 20:17 /user/hadoop
3、上传文件: hdfs dfs -put input /user/hadoop
查看上传的文件,
hadoop@h1:~$ hdfs dfs -ls /user/hadoop
Found 1 items
-rw-r--r-- 2 hadoop supergroup 49 2015-03-22 20:21 /user/hadoop/input
4、运行wordcount程序
hadoop jar /home/hadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.5.1.jar wordcount /user/hadoop/input /user/hadoop/output
5、查看运行结果
hadoop@h1:~$ hdfs dfs -ls /user/hadoopFound 2 items
-rw-r--r-- 2 hadoop supergroup 49 2015-03-22 20:21 /user/hadoop/input
drwxr-xr-x - hadoop supergroup 0 2015-03-22 20:26 /user/hadoop/output
hadoop@h1:~$ hdfs dfs -ls /user/hadoop/output
Found 2 items
-rw-r--r-- 2 hadoop supergroup 0 2015-03-22 20:26 /user/hadoop/output/_SUCCESS
-rw-r--r-- 2 hadoop supergroup 64 2015-03-22 20:26 /user/hadoop/output/part-r-00000
hadoop@h1:~$ hdfs dfs -cat /user/hadoop/output/part-r-00000
Hadoop 1
Hello 1
My 1
example. 1
first 1
hadoop 1
in 1
input. 1