首先来介绍一下我的集群分布:
主机名: master01 slave01 slave02
HDFS namenode SecondaryNamenode
datanode datanode datanode
historyserver
YARN resourcemanager
nodemanager nodemanager nodemanager
三台主机分别是master01,slave01,slave02集群分布如上所示;根据HDFS,yarn分布的不同代码做相应改变就可以。
启动:
#!/bin/sh
#我启动第一台的HDFS可以将其他两台的也连带启动,如果这样不行可以逐个启动。
echo -e "start hdfs"
/opt/modules/hadoop-2.5.0-cdh5.3.6/sbin/start-dfs.sh
sleep 1s
echo -e "start history"
/opt/modules/hadoop-2.5.0-cdh5.3.6/sbin/mr-jobhistory-daemon.sh start historyserver
sleep 1s
#hadoop为我的普通用户名
echo -e "start resourcemanager"
for i in hadoop@slave01
do
ssh $i '/opt/modules/hadoop-2.5.0-cdh5.3.6/sbin/yarn-daemon.sh start resourcemanager'
done
sleep 1s
echo -e "start notemanager"
for i in hadoop@master01 hadoop@slave01 hadoop@slave02
do
ssh $i '/opt/modules/hadoop-2.5.0-cdh5.3.6/sbin/yarn-daemon.sh start nodemanager'
done
echo -e "nice oh my baby"
停止:只需将start改为stop即可。