伪分布式安装笔记3

伪分布式安装笔记三

验证是否成功：

jps

SecondaryNameNode
DataNode
NameNode
Jps

查看日志：hadoop-5.7.0…/logs/…logs这个文件查看

浏览器访问 http://hadoop000:50070 但是这里遇到问题，只能通过ip来访问，无法通过hadoop访问

停止hdfs：

sbin/stop-dfs.sh

Hadoop shell的基本使用

hadoop dfs与hadoop fs都可以

hadoop fs -ls /

查看目录下有啥

hadoop fs -put hello.txt /

将文件放到目录下

hadoop fs -ls /

查看

18/12/09 20:23:58 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
Found 1 items
-rw-r–r-- 1 hadoop supergroup 49 2018-12-09 20:23 /hello.txt

hadoop fs -text /hello.txt

查看具体内容

18/12/09 20:24:36 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
hadoop welcome
hadoop hdfs mapreduce
hadoop hdfs

hadoop fs -mkdir /test

新建文件夹test

18/12/09 20:25:03 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable

hadoop fs -ls /

查看目录下的内容

18/12/09 20:25:16 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
Found 2 items
-rw-r–r-- 1 hadoop supergroup 49 2018-12-09 20:23 /hello.txt
drwxr-xr-x - hadoop supergroup 0 2018-12-09 20:25 /test
hadoop fs -mkdir /test/a/b

试图递归创建文件夹

18/12/09 20:25:35 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
mkdir: /test/a/b': No such file or directory

失败
[hadoop@hadoop000 data]$ hadoop fs -mkdir -p /test/a/b

递归创建文件夹

18/12/09 20:26:09 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable

hadoop fs -ls /
18/12/09 20:26:15 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
Found 2 items
-rw-r–r-- 1 hadoop supergroup 49 2018-12-09 20:23 /hello.txt
drwxr-xr-x - hadoop supergroup 0 2018-12-09 20:26 /test

hadoop fs -ls /text
18/12/09 20:26:29 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
ls: `/text’: No such file or directory
[hadoop@hadoop000 data]$ hadoop fs -ls /test
18/12/09 20:26:40 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
Found 1 items
drwxr-xr-x - hadoop supergroup 0 2018-12-09 20:26 /test/a
[hadoop@hadoop000 data]$ hadoop fs -ls /test/a
18/12/09 20:26:45 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
Found 1 items
drwxr-xr-x - hadoop supergroup 0 2018-12-09 20:26 /test/a/b

hadoop fs -ls /test/a/b
18/12/09 20:26:55 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable

查看文件夹

hadoop fs -lsr /

递归展示文件夹

lsr: DEPRECATED: Please use ‘ls -R’ instead.
18/12/09 20:27:08 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
-rw-r–r-- 1 hadoop supergroup 49 2018-12-09 20:23 /hello.txt
drwxr-xr-x - hadoop supergroup 0 2018-12-09 20:26 /test
drwxr-xr-x - hadoop supergroup 0 2018-12-09 20:26 /test/a
drwxr-xr-x - hadoop supergroup 0 2018-12-09 20:26 /test/a/b

hadoop fs -copyFromLocal hello.txt /test/a/b/h.txt

copy文件到指定文件夹下

hadoop fs -lsr /
lsr: DEPRECATED: Please use ‘ls -R’ instead.（两个都行）之后递归展示文件夹

hadoop fs -cat /test/a/b/h.txt查看文件，结果

hadoop welcome
hadoop hdfs mapreduce
hadoop hdfs

hadoop fs -get /test/a/b/h.txt copy到本地

hadoop fs -rm /hello.txt删除文件

hadoop fs -rm -R /test删除文件夹

hadoop fs -put hello.txt /执行之后打开浏览器可以找到该文件

Utilities/ Browse the file system

然后把hadoop安装包放在了根目录下，这样打开浏览发现占用了3个block。因为文件包比两个block大比三个小