大数据Hadoop集群删除节点

Hadoop集群删除节点

nn01主机

[root@nn01 ~]# cat /usr/local/hadoop/etc/hadoop/slaves //注释或删除node4
node1
node2
node3
#node4

[root@nn01 hadoop]# tail /usr/local/hadoop/etc/hadoop/hdfs-site.xml //修改配置文件

…
//增加4行
dfs.hosts.exclude
/usr/local/hadoop/etc/hadoop/exclude

[root@nn01 hadoop]# cat /usr/local/hadoop/etc/hadoop/exclude //写入文件,每个主机单独一行
node4

导出数据

[root@nn01 hadoop]# ./bin/hdfs dfsadmin -refreshNodes
Refresh nodes successful
[root@nn01 hadoop]# ./bin/hdfs dfsadmin -report
…
Name: 192.168.1.64:50010 (node4)
Hostname: node4
Decommission Status : Decommission in progress //显示正在导出文件,文件大小绝对导出的时间,唯一能做的就是等
Configured Capacity: 21463281664 (19.99 GB)
DFS Used: 8192 (8 KB)
Non DFS Used: 1584435200 (1.48 GB)
DFS Remaining: 19878838272 (18.51 GB)
DFS Used%: 0.00%
DFS Remaining%: 92.62%
Configured Cache Capacity: 0 (0 B)
Cache Used: 0 (0 B)
Cache Remaining: 0 (0 B)
Cache Used%: 100.00%
Cache Remaining%: 0.00%
Xceivers: 1
Last contact: Fri Jul 19 11:48:23 CST 2019
…

过段时间在查看
[root@nn01 hadoop]# ./bin/hdfs dfsadmin -report
…
Name: 192.168.1.64:50010 (node4)
Hostname: node4
Decommission Status : Decommissioned //显示导出数据完成
Configured Capacity: 21463281664 (19.99 GB)
DFS Used: 8192 (8 KB)
Non DFS Used: 1584435200 (1.48 GB)
DFS Remaining: 19878838272 (18.51 GB)
DFS Used%: 0.00%
DFS Remaining%: 92.62%
Configured Cache Capacity: 0 (0 B)
Cache Used: 0 (0 B)
Cache Remaining: 0 (0 B)
Cache Used%: 100.00%
Cache Remaining%: 0.00%
Xceivers: 1
Last contact: Fri Jul 19 11:48:38 CST 2019
…

node4主机

[root@node4 ~]# cd /usr/local/hadoop/
[root@node4 hadoop]# ./sbin/hadoop-daemon.sh stop datanode //停止datanode

[root@node4 hadoop]# ./sbin/yarn-daemon.sh start nodemanager //yarn 增加 nodemanager
starting nodemanager, logging to /usr/local/hadoop/logs/yarn-root-nodemanager-node4.out
[root@node4 hadoop]# ./sbin/yarn-daemon.sh stop nodemanager //停止nodemanager
stopping nodemanager

[root@node4 hadoop]# ./bin/yarn node -list //yarn 查看节点状态，还是有node4节点，要过一段时间才会消失
19/07/19 11:51:29 INFO client.RMProxy: Connecting to ResourceManager at nn01/192.168.1.60:8032
Total Nodes:4
Node-Id Node-State Node-Http-Address Number-of-Running-Containers
node3:44468 RUNNING node3:8042 0
node1:38920 RUNNING node1:8042 0
node4:42753 RUNNING node4:8042 0
node2:44296 RUNNING node2:8042 0
[root@node4 hadoop]#

-----------删除节点完成______________