hadoop+intellij+maven运行wordcount程序

hadoop+intellij+maven实现wordcount程序的两篇博客

https://blog.csdn.net/jiede1/article/details/78835340

https://www.polarxiong.com/archives/Hadoop-Intellij%E7%BB%93%E5%90%88Maven%E6%9C%AC%E5%9C%B0%E8%BF%90%E8%A1%8C%E5%92%8C%E8%B0%83%E8%AF%95MapReduce%E7%A8%8B%E5%BA%8F-%E6%97%A0%E9%9C%80%E6%90%AD%E8%BD%BDHadoop%E5%92%8CHDFS%E7%8E%AF%E5%A2%83.html

在浏览器上观看hdfs

http://sunpc:50070

我主机号(localhost)sunpc

从hdfs中运行wordcount 

hadoop jar /usr/local/hadoop/hadoop-client-2.7.1.jar WordCount hdfs://localhost:9000/user/sun/input/file1.txt hdfs://localhost:9000/output

hdfs里的位置

hdfs://localhost:9000/user/sun

查看hdfs中所有文件

hadoop fs -ls -R /

part-r-00000为wordcount输出后的文件

hdfs dfs -cat /output/part-r-00000

sun@SunPC:~$ hadoop fs -ls -R /
19/11/12 23:53:23 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
drwxr-xr-x   - sun supergroup          0 2019-10-26 23:38 /input
-rw-r--r--   1 sun supergroup       1366 2019-09-26 20:44 /input/README.txt
-rw-r--r--   1 sun supergroup         44 2019-10-25 11:20 /input/hadoop.txt
drwxr-xr-x   - sun supergroup          0 2019-11-12 23:44 /output
-rw-r--r--   1 sun supergroup          0 2019-11-12 23:44 /output/_SUCCESS
-rw-r--r--   1 sun supergroup         16 2019-11-12 23:44 /output/part-r-00000
drwxr-xr-x   - sun supergroup          0 2019-10-26 22:48 /user
drwxr-xr-x   - sun supergroup          0 2019-11-12 23:28 /user/sun
drwxr-xr-x   - sun supergroup          0 2019-10-26 23:34 /user/sun/dir0
drwxr-xr-x   - sun supergroup          0 2019-10-26 23:29 /user/sun/dir1
drwxr-xr-x   - sun supergroup          0 2019-10-26 23:31 /user/sun/dir1/dir2
drwxr-xr-x   - sun supergroup          0 2019-11-12 23:14 /user/sun/input
-rw-r--r--   1 sun supergroup         12 2019-11-12 23:14 /user/sun/input/file1.txt
-rw-r--r--   1 sun supergroup         13 2019-11-12 23:14 /user/sun/input/file2.txt
drwxr-xr-x   - sun supergroup          0 2019-11-12 23:28 /user/sun/output
-rw-r--r--   1 sun supergroup          0 2019-11-12 23:28 /user/sun/output/_SUCCESS
-rw-r--r--   1 sun supergroup         25 2019-11-12 23:28 /user/sun/output/part-r-00000
drwxr-xr-x   - sun supergroup          0 2019-10-26 22:42 /usr
drwxr-xr-x   - sun supergroup          0 2019-10-26 22:42 /usr/sun