Datanode多目录配置

参考尚硅谷hadoop 教程
链接：http://i8n.cn/U4sxdj

1. DataNode也可以配置成多个目录，每个目录存储的数据不一样。即：数据不是副本
   2．具体配置如下
   hdfs-site.xml

<property>
        <name>dfs.datanode.data.dir</name>
<value>file:///${hadoop.tmp.dir}/dfs/data1,file:///${hadoop.tmp.dir}/dfs/data2</value>
</property>

3.停止集群，删除data和logs中所有数据。

[hadoop@hadoop102 hadoop-2.7.2]$ rm -rf data/ logs/
[hadoop@hadoop103 hadoop-2.7.2]$ rm -rf data/ logs/
[hadoop@hadoop104 hadoop-2.7.2]$ rm -rf data/ logs/

（3）格式化集群并启动。

[hadoop@hadoop102 hadoop-2.7.2]$ bin/hdfs namenode –format
[hadoop@hadoop102 hadoop-2.7.2]$ sbin/start-dfs.sh

（4）查看结果

[hadoop@hadoop102 subdir0]$ cd /opt/module/hadoop-2.7.2/data/tmp/dfs/
[hadoop@hadoop102 dfs]$ ll
total 0
drwx------. 3 hadoop hadoop 40 Aug 16 11:46 data1
drwx------. 3 hadoop hadoop 40 Aug 16 11:46 data2
drwxrwxr-x. 3 hadoop hadoop 40 Aug 16 11:46 name

[hadoop@hadoop102 dfs]$ hadoop fs -put /opt/module/hadoop-2.7.2/xinyue.txt /
[hadoop@hadoop102 subdir0]$ pwd
/opt/module/hadoop-2.7.2/data/tmp/dfs/data1/current/BP-2064754349-192.168.88.102-1597592761743/current/finalized/subdir0/subdir0
[hadoop@hadoop102 subdir0]$ cat blk_1073741825
wo shi xinyue

[hadoop@hadoop102 finalized]$ pwd
/opt/module/hadoop-2.7.2/data/tmp/dfs/data2/current/BP-2064754349-192.168.88.102-1597592761743/current/finalized
[hadoop@hadoop102 finalized]$ hadoop fs -put /opt/module/hadoop-2.7.2/
bin/              lib/              NOTICE.txt        wcinput/
bossxiang.txt     libexec/          README.txt        xinyue.txt
data/             LICENSE.txt       safemode.sh       zaiyiqi.txt
etc/              liubei.txt        sbin/             .zaiyiqi.txt.crc
include/          logs/             share/            
[hadoop@hadoop102 finalized]$ hadoop fs -put /opt/module/hadoop-2.7.2/zaiyiqi.txt /
[hadoop@hadoop102 finalized]$ cd subdir0/subdir0/
[hadoop@hadoop102 subdir0]$ ll
total 8
-rw-rw-r--. 1 hadoop hadoop 29 Aug 16 11:52 blk_1073741826
-rw-rw-r--. 1 hadoop hadoop 11 Aug 16 11:52 blk_1073741826_1002.meta
[hadoop@hadoop102 subdir0]$ cat blk_1073741826
woshibossxiang
wo shi xinyue

几百本常用电子书免费领取：https://github.com/XiangLinPro/IT_book