【大数据学习】之MapReduce Job

1)、先把yarn服务停了
[hadoop@hadoop001 hadoop-2.6.0-cdh5.7.0]$ sbin/stop-yarn.sh

2)、把之前的信息删了
[hadoop@hadoop001 hadoop-2.6.0-cdh5.7.0]$ hdfs dfs -rm -r -f /user

3)、再创建hdfs的文件
bin/hdfs dfs -mkdir /user
bin/hdfs dfs -mkdir -p /user/hadoop/input

4)、选择上传文件到hdfs
bin/hdfs dfs -put etc/hadoop/core-site.xml /user/hadoop/input  #就选一个文件core-site.xml，如果文件太大会跑不起

5)、启动yarn服务
[hadoop@hadoop001 hadoop-2.6.0-cdh5.7.0]$ sbin/start-yarn.sh

6)、执行下面
bin/hadoop jar \
share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0-cdh5.7.0.jar \
grep \
/user/hadoop/input \
/user/hadoop/output \
'fs[a-z.]+'

7)从hdfs的输出结果下载到本地
bin/hdfs dfs -get output output

8)查看结果
cat output/*