Hadoop Command Summary

List file is:

$ ./hadoop fs -ls

Found 17 items

-rwxr-xr-x   1 yj70978 retailfi       1259 2013-01-30 21:05/home/yj70978/hadoop/hadoop-1.1.2/bin/start-mapred.sh

-rwxr-xr-x   1 yj70978 retailfi       2642 2013-01-30 21:05/home/yj70978/hadoop/hadoop-1.1.2/bin/hadoop-config.sh

-rwxr-xr-x   1 yj70978 retailfi       2810 2013-01-30 21:05/home/yj70978/hadoop/hadoop-1.1.2/bin/rcc

-rwxr-xr-x   1 yj70978 retailfi      14189 2013-07-22 07:58/home/yj70978/hadoop/hadoop-1.1.2/bin/hadoop

-rwxr-xr-x   1 yj70978 retailfi       1329 2013-01-30 21:05/home/yj70978/hadoop/hadoop-1.1.2/bin/hadoop-daemons.sh

-rwxr-xr-x   1 yj70978 retailfi       1145 2013-01-30 21:05 /home/yj70978/hadoop/hadoop-1.1.2/bin/start-jobhistoryserver.sh

-rwxr-xr-x   1 yj70978 retailfi       2143 2013-01-30 21:05/home/yj70978/hadoop/hadoop-1.1.2/bin/slaves.sh

-rwxr-xr-x   1 yj70978 retailfi       1116 2013-01-30 21:05/home/yj70978/hadoop/hadoop-1.1.2/bin/stop-balancer.sh

-rwxr-xr-x   1 yj70978 retailfi       1745 2013-01-30 21:05/home/yj70978/hadoop/hadoop-1.1.2/bin/start-dfs.sh

-rwxr-xr-x   1 yj70978 retailfi       1168 2013-01-30 21:05/home/yj70978/hadoop/hadoop-1.1.2/bin/stop-mapred.sh

-rwxr-xr-x   1 yj70978 retailfi       1246 2013-01-30 21:05/home/yj70978/hadoop/hadoop-1.1.2/bin/stop-dfs.sh

-rwxr-xr-x   1 yj70978 retailfi       1166 2013-01-30 21:05/home/yj70978/hadoop/hadoop-1.1.2/bin/start-all.sh

-rwxr-xr-x   1 yj70978 retailfi       1119 2013-01-30 21:05/home/yj70978/hadoop/hadoop-1.1.2/bin/stop-all.sh

-rwxr-xr-x   1 yj70978 retailfi      63970 2013-01-30 21:06/home/yj70978/hadoop/hadoop-1.1.2/bin/task-controller

-rwxr-xr-x   1 yj70978 retailfi       1065 2013-01-30 21:05/home/yj70978/hadoop/hadoop-1.1.2/bin/start-balancer.sh

-rwxr-xr-x   1 yj70978 retailfi       1131 2013-01-30 21:05/home/yj70978/hadoop/hadoop-1.1.2/bin/stop-jobhistoryserver.sh

-rwxr-xr-x   1 yj70978 retailfi       4649 2013-01-30 21:05/home/yj70978/hadoop/hadoop-1.1.2/bin/hadoop-daemon.sh

HDFS has a defaultworking directory of /user/$USER, where $USER is your login user name. Thisdirectory isn’t automatically created for you, though, so let’s create it withthe mkdir command.

List all ofsubdirectories,

hadoop fs -lsr/user

Copy file from localfilesystem to HDFS,

$ hadoop fs -put1.txt /user/mz50947

                No encryption was performed bypeer.

$ hadoop fs -ls/user/mz50947

                No encryption was performed bypeer.

Found 2 items

-rw-r--r--   3 mz50947 enterpriserisk          0 2013-07-23 01:39 /user/mz50947/1

-rw-r--r--   3 mz50947 enterpriserisk          0 2013-07-23 01:40/user/mz50947/1.txt

Delete a file inHDFS,

$ hadoop fs -rm/user/mz50947/1.txt

                No encryption was performed bypeer.

Moved:'hdfs://bdwar001m01l.nam.nsroot.net:8020/user/mz50947/1.txt' to trash at:hdfs://bdwar001m01l.nam.nsroot.net:8020/user/mz50947/.Trash/Current

See content of afile,

hadoop fs -cat/user/mz50947/1.txt

                No encryption was performed bypeer.

Touch

Get a file fromHDFS to local filesystem,

hadoop fs -get/user/mz50947/1.txt .

Looking up help,

hadoop fs –help