HDFS架构&理解数据块、副本数、小文件的概念&改变hdfs存储目录&NN和SNN交互流程

1.改变HDFS文件的存储目录

官方默认配置为/tmp路径下 所以我们需要该路径只需要改变这个参数即可，修改配置文件之前，先将原来生成的文件移动一下

[wzj@hadoop001 ~]$ pwd
/home/wzj
[wzj@hadoop001 hadoop-wzj]$ cd dfs
[wzj@hadoop001 dfs]$ ll
total 0
drwx------. 3 wzj wzj 21 Dec 7 16:59 data
drwxrwxr-x. 3 wzj wzj 21 Dec 7 16:59 name
drwxrwxr-x. 3 wzj wzj 21 Dec 7 16:59 namesecondary
[wzj@hadoop001 dfs]$ pwd
/tmp/hadoop-wzj/dfs
[wzj@hadoop001 dfs]$ mv /tmp/hadoop-wzj/dfs /home/wzj/tmp/

修改配置文件

[wzj@hadoop001 hadoop]$ vi core-site.xml
<configuration>
    <property>
        <name>fs.defaultFS</name>
        <value>hdfs://hadoop001:9000</value>
    </property>
    <property>
        <name>hadoop.tmp.dir</name>
        <value>/home/wzj/tmp</value>
    </property>
</configuration>

启动hadoop，执行测试文件

[wzj@hadoop001 subdir0]$ ll
total 216
-rw-rw-r–. 1 wzj wzj 14 Dec 2 14:04 blk_1073741825
-rw-rw-r–. 1 wzj wzj 11 Dec 2 14:04 blk_1073741825_1001.meta
-rw-rw-r–. 1 wzj wzj 93 Dec 2 18:04 blk_1073741826
-rw-rw-r–. 1 wzj wzj 11 Dec 2 18:04 blk_1073741826_1002.meta
-rw-rw-r–. 1 wzj wzj 135 Dec 2 18:09 blk_1073741834
-rw-rw-r–. 1 wzj wzj 11 Dec 2 18:09 blk_1073741834_1010.meta
-rw-rw-r–. 1 wzj wzj 346 Dec 2 18:09 blk_1073741835
-rw-rw-r–. 1 wzj wzj 11 Dec 2 18:09 blk_1073741835_1011.meta
-rw-rw-r–. 1 wzj wzj 33608 Dec 2 18:09 blk_1073741836
-rw-rw-r–. 1 wzj wzj 271 Dec 2 18:09 blk_1073741836_1012.meta
-rw-rw-r–. 1 wzj wzj 141062 Dec 2 18:09 blk_1073741837
-rw-rw-r–. 1 wzj wzj 1111 Dec 2 18:09 blk_1073741837_1013.meta
[wzj@hadoop001 subdir0]$ hadoop fs -put /home/wzj/ce.log /
[wzj@hadoop001 subdir0]$ ll
total 224
-rw-rw-r–. 1 wzj wzj 14 Dec 2 14:04 blk_1073741825
-rw-rw-r–. 1 wzj wzj 11 Dec 2 14:04 blk_1073741825_1001.meta
-rw-rw-r–. 1 wzj wzj 93 Dec 2 18:04 blk_1073741826
-rw-rw-r–