运行MR JOB

1.Make the HDFS directories required to execute MapReduce jobs:

[hadoop@hylct hadoop-2.6.0-cdh5.7.0]$ bin/hdfs dfs -mkdir -p /user/hadoop

2.Copy the input files into the distributed filesystem:

[hadoop@hylct hadoop-2.6.0-cdh5.7.0]$ bin/hdfs dfs -put etc/hadoop input
[hadoop@hylct hadoop-2.6.0-cdh5.7.0]$ bin/hdfs dfs -ls /user/hadoop
18/10/10 15:41:05 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Found 1 items
drwxr-xr-x   - hadoop supergroup          0 2018-10-10 15:38 /user/hadoop/input

3.Run some of the examples provided:

[hadoop@hylct hadoop-2.6.0-cdh5.7.0]$ bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0-cdh5.7.0.jar grep input output 'dfs[a-z.]+'
18/10/10 18:53:46 INFO mapreduce.Job:  map 0% reduce 0%
18/10/10 18:59:36 INFO mapreduce.Job:  map 4% reduce 0%
18/10/10 19:00:00 INFO mapreduce.Job:  map 6% reduce 0%
18/10/10 19:00:10 INFO mapreduce.Job:  map 7% reduce 0%
18/10/10 19:00:37 INFO mapreduce.Job:  map 20% reduce 0%
18/10/10 19:04:11 INFO mapreduce.Job:  map 40% reduce 0%
18/10/10 19:08:20 INFO mapreduce.Job:  map 43% reduce 0%
18/10/10 19:08:26 INFO mapreduce.Job:  map 56% reduce 0%
18/10/10 19:08:27 INFO mapreduce.Job:  map 57% reduce 17%
18/10/10 19:08:30 INFO mapreduce.Job:  map 57% reduce 19%
18/10/10 19:11:59 INFO mapreduce.Job:  map 63% reduce 19%
18/10/10 19:12:02 INFO mapreduce.Job:  map 72% reduce 19%
18/10/10 19:12:03 INFO mapreduce.Job:  map 73% reduce 19%
18/10/10 19:12:08 INFO mapreduce.Job:  map 73% reduce 24%

…
4.Examine the output files:

[hadoop@hylct hadoop-2.6.0-cdh5.7.0]$ bin/hdfs dfs -get output output
[hadoop@hylct hadoop-2.6.0-cdh5.7.0]$ cat output/*