解决停止hadoop集群时,效率低问题
当搭建好了hadoop集群时,启动hadoop集群后,需要停止集群工作,需要先停止yarn,需要停止hdfs,需要停止zookeeper,很麻烦呀,效率太低了,有木有!!!!!!!!!!
当然,前题是搭建起来了hadoop集群,可以参考我搭建的hadoop集群
以下是针对我自己搭建的hadoop集群,编写的停止脚本
#!/bin/bash
#我们将脚本存入在it01,因为它有到02、03、04、05、06的免登录
clear
echo "->->->->->->->->->->->->stop it03 yarn------------------------------"
ip=it03
ssh root@$ip "source /etc/profile;/it/hadoop-2.2.0/sbin/stop-yarn.sh"
ssh root@$ip "source /etc/profile;jps"
echo "->->->->->->->->->->->->stop it01 it02 hdfs---------------------"
ip=it01
ssh root@$ip "source /etc/profile;/it/hadoop-2.2.0/sbin/stop-dfs.sh"
ip=it01
ssh root@$ip "source /etc/profile;jps"
ip=it02
ssh root@$ip "source /etc/profile;jps"
echo "->->->->->->->->->->->->stop zkServer-----------------------------------"
for ip in it04 it05 it06
do
echo "ssh to $i"
ssh root@$ip "source /etc/profile;/it/zookeeper-3.4.6/bin/zkServer.sh stop"
ssh root@$ip "source /etc/profile;jps"
done
执行过程如下:
->->->->->->->->->->->->stop it03 yarn------------------------------
stopping yarn daemons
stopping resourcemanager
it06: stopping nodemanager
it05: stopping nodemanager
it04: stopping nodemanager
it03: stopping nodemanager
no proxyserver to stop
7252 Jps
->->->->->->->->->->->->stop itcast01 it02 hdfs---------------------
Stopping namenodes on [itcast01 itcast02]
it01: stopping namenode
it02: stopping namenode
it05: stopping datanode
it04: stopping datanode
it06: stopping datanode
Stopping journal nodes [it04 it05 it06]
it05: stopping journalnode
it06: stopping journalnode
it04: stopping journalnode
Stopping ZK Failover Controllers on NN hosts [it01 it02]
it01: stopping zkfc
it02: stopping zkfc
8163 Jps
5967 Jps
->->->->->->->->->->->->stop zkServer-----------------------------------
ssh to it04
JMX enabled by default
Using config: /itcast/zookeeper-3.4.5/bin/../conf/zoo.cfg
Stopping zookeeper ... STOPPED
4513 Jps
ssh to it05
JMX enabled by default
Using config: /itcast/zookeeper-3.4.5/bin/../conf/zoo.cfg
Stopping zookeeper ... STOPPED
4620 Jps
ssh to it06
JMX enabled by default
Using config: /it/zookeeper-3.4.5/bin/../conf/zoo.cfg
Stopping zookeeper ... STOPPED
4476 Jps
[root@it01 ~]#
成功停止hadoop集群!!!又可以偷懒了!!!
文章最后,给大家推荐一些受欢迎的技术博客链接:
- Hadoop相关技术博客链接
- Spark 核心技术链接
- JAVA相关的深度技术博客链接
- 超全干货--Flink思维导图,花了3周左右编写、校对
- 深入JAVA 的JVM核心原理解决线上各种故障【附案例】
- 请谈谈你对volatile的理解?--最近小李子与面试官的一场“硬核较量”
- 聊聊RPC通信,经常被问到的一道面试题。源码+笔记,包懂
欢迎扫描下方的二维码或 搜索 公众号“10点进修”,我们会有更多、且及时的资料推送给您,欢迎多多交流!