hadoop集群启动脚本——解决启动hadoop集群时，效率低问题

解决启动hadoop集群时，效率低问题

当搭建好了hadoop集群时，需要先启动协调zookeeper，再启动hdfs，最后启动yarn，很麻烦呀，效率太低了，有木有！！！！！！！！！！

当然，前题是搭建起来了hadoop集群，可以参考我搭建的hadoop集群

1.参考zookeeper搭建

2.参考hadoop集群搭建

以下是针对我自己搭建的hadoop集群，编写的启动脚本

 

#!/bin/bash
#我们将脚本存入在it01，因为它有到02、03、04、05、06的免登录

clear
echo "->->->->->->->->->->->->start zkServer-----------------------------------"
for ip in it04 it05 it06
do
    echo "ssh to $ip"
    ssh root@$ip "source /etc/profile;/it/zookeeper-3.4.6/bin/zkServer.sh start"
    ssh root@$ip "source /etc/profile;jps"
done


echo "->->->->->->->->->->->->start it01 it02 hdfs---------------------"
ip=it01
ssh root@$ip "source /etc/profile;/it/hadoop-2.2.0/sbin/start-dfs.sh"
ip=it01
ssh root@$ip "source /etc/profile;jps"
ip=it02
ssh root@$ip "source /etc/profile;jps"


echo "->->->->->->->->->->->->start it03 yarn------------------------------"
ip=it03
ssh root@$ip "source /etc/profile;/it/hadoop-2.2.0/sbin/start-yarn.sh"
ssh root@$ip "source /etc/profile;jps"

 

执行过程如下：

[root@itcast01 ~]# ./start_hadoop.sh 

->->->->->->->->->->->->start zkServer-----------------------------------
ssh to it04
JMX enabled by default
Using config: /it/zookeeper-3.4.5/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
4049 Jps
4016 QuorumPeerMain
ssh to it05
JMX enabled by default
Using config: /it/zookeeper-3.4.5/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
4114 QuorumPeerMain
4150 Jps
ssh to itcast06
JMX enabled by default
Using config: /it/zookeeper-3.4.5/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
4017 Jps
3977 QuorumPeerMain
->->->->->->->->->->->->start it01 it02 hdfs---------------------
Starting namenodes on [it01 it02]
it01: starting namenode, logging to /it/hadoop-2.2.0/logs/hadoop-root-namenode-it01.out
it02: starting namenode, logging to /it/hadoop-2.2.0/logs/hadoop-root-namenode-it02.out
it05: starting datanode, logging to /it/hadoop-2.2.0/logs/hadoop-root-datanode-it05.out
it04: starting datanode, logging to /it/hadoop-2.2.0/logs/hadoop-root-datanode-it04.out
it06: starting datanode, logging to /it/hadoop-2.2.0/logs/hadoop-root-datanode-it06.out
Starting journal nodes [it04 it05 it06]
it05: starting journalnode, logging to /it/hadoop-2.2.0/logs/hadoop-root-journalnode-it05.out
it06: starting journalnode, logging to /it/hadoop-2.2.0/logs/hadoop-root-journalnode-it06.out
it04: starting journalnode, logging to /it/hadoop-2.2.0/logs/hadoop-root-journalnode-it04.out
Starting ZK Failover Controllers on NN hosts [it01 it02]
it02: starting zkfc, logging to /it/hadoop-2.2.0/logs/hadoop-root-zkfc-it02.out
it01: starting zkfc, logging to /it/hadoop-2.2.0/logs/hadoop-root-zkfc-it01.out
7702 DFSZKFailoverController
7763 Jps
7431 NameNode
5695 NameNode
5794 DFSZKFailoverController
5863 Jps
->->->->->->->->->->->->start it03 yarn------------------------------
starting yarn daemons
starting resourcemanager, logging to /it/hadoop-2.2.0/logs/yarn-root-resourcemanager-it03.out
it04: starting nodemanager, logging to /it/hadoop-2.2.0/logs/yarn-root-nodemanager-it04.out
it06: starting nodemanager, logging to /it/hadoop-2.2.0/logs/yarn-root-nodemanager-it06.out
it05: starting nodemanager, logging to /it/hadoop-2.2.0/logs/yarn-root-nodemanager-it05.out
it03: starting nodemanager, logging to /it/hadoop-2.2.0/logs/yarn-root-nodemanager-it03.out
4575 NodeManager
4464 ResourceManager
4792 Jps
[root@it01 ~]#

到这里了，恭喜你，成功启动hadoop集群！！！

hadoop集群停止运行脚本链接