向hdfs上传本地文件-Hello World

[hadoop@Master ~]$ hadoop dfs -ls
ls: Cannot access .: No such file or directory.
[hadoop@Master ~]$ hadoop dfs -put /input in
put: File /input does not exist.
[hadoop@Master ~]$ hadoop dfs -ls
ls: Cannot access .: No such file or directory.
[hadoop@Master ~]$ hadoop dfs -mkdir in
[hadoop@Master ~]$ hadoop dfs -ls
Found 1 items
drwxr-xr-x   - hadoop supergroup          0 2014-02-05 19:07 /user/hadoop/in
[hadoop@Master ~]$ hadoop dfs -put /input in
put: File /input does not exist.
[hadoop@Master ~]$ hadoop dfs -put input in
[hadoop@Master ~]$ hadoop dfs -ls
Found 1 items
drwxr-xr-x   - hadoop supergroup          0 2014-02-05 19:07 /user/hadoop/in
[hadoop@Master ~]$ hadoop dfs -ls in
Found 1 items
drwxr-xr-x   - hadoop supergroup          0 2014-02-05 19:07 /user/hadoop/in/input
[hadoop@Master ~]$ hadoop dfs -ls in/input
Found 2 items
-rw-r--r--   1 hadoop supergroup         12 2014-02-05 19:07 /user/hadoop/in/input/test1.txt

-rw-r--r--   1 hadoop supergroup         13 2014-02-05 19:07 /user/hadoop/in/input/test2.txt


[hadoop@Master hadoop]$ hadoop jar hadoop-0.20.2-examples.jar wordcount in/input/ out
14/02/05 19:16:10 INFO input.FileInputFormat: Total input paths to process : 2
14/02/05 19:16:10 INFO mapred.JobClient: Running job: job_201402051900_0001
14/02/05 19:16:11 INFO mapred.JobClient:  map 0% reduce 0%
14/02/05 19:16:24 INFO mapred.JobClient:  map 50% reduce 0%
14/02/05 19:16:30 INFO mapred.JobClient:  map 100% reduce 0%
14/02/05 19:16:33 INFO mapred.JobClient:  map 100% reduce 16%
14/02/05 19:16:43 INFO mapred.JobClient:  map 100% reduce 100%
14/02/05 19:16:45 INFO mapred.JobClient: Job complete: job_201402051900_0001
14/02/05 19:16:45 INFO mapred.JobClient: Counters: 18
14/02/05 19:16:45 INFO mapred.JobClient:   Job Counters
14/02/05 19:16:45 INFO mapred.JobClient:     Launched reduce tasks=1
14/02/05 19:16:45 INFO mapred.JobClient:     Rack-local map tasks=1
14/02/05 19:16:45 INFO mapred.JobClient:     Launched map tasks=2
14/02/05 19:16:45 INFO mapred.JobClient:     Data-local map tasks=1
14/02/05 19:16:45 INFO mapred.JobClient:   FileSystemCounters
14/02/05 19:16:45 INFO mapred.JobClient:     FILE_BYTES_READ=55
14/02/05 19:16:45 INFO mapred.JobClient:     HDFS_BYTES_READ=25
14/02/05 19:16:45 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=180
14/02/05 19:16:45 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=25
14/02/05 19:16:45 INFO mapred.JobClient:   Map-Reduce Framework
14/02/05 19:16:45 INFO mapred.JobClient:     Reduce input groups=3
14/02/05 19:16:45 INFO mapred.JobClient:     Combine output records=4
14/02/05 19:16:45 INFO mapred.JobClient:     Map input records=2
14/02/05 19:16:45 INFO mapred.JobClient:     Reduce shuffle bytes=61
14/02/05 19:16:45 INFO mapred.JobClient:     Reduce output records=3
14/02/05 19:16:45 INFO mapred.JobClient:     Spilled Records=8
14/02/05 19:16:45 INFO mapred.JobClient:     Map output bytes=41
14/02/05 19:16:45 INFO mapred.JobClient:     Combine input records=4
14/02/05 19:16:45 INFO mapred.JobClient:     Map output records=4
14/02/05 19:16:45 INFO mapred.JobClient:     Reduce input records=4


[hadoop@Master hadoop]$ hadoop dfs -ls
Found 2 items
drwxr-xr-x   - hadoop supergroup          0 2014-02-05 19:07 /user/hadoop/in
drwxr-xr-x   - hadoop supergroup          0 2014-02-05 19:16 /user/hadoop/out
[hadoop@Master hadoop]$ hadoop dfs -ls ./out
Found 2 items
drwxr-xr-x   - hadoop supergroup          0 2014-02-05 19:16 /user/hadoop/out/_logs
-rw-r--r--   1 hadoop supergroup         25 2014-02-05 19:16 /user/hadoop/out/part-r-00000
[hadoop@Master hadoop]$ hadoop dfs -cat ./out/part-r-00000
hadoop    1
hello    2
world    1


  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值