hadoop两个常用脚本

集群启动停止方式总结

• 各个模块分开启动/停止

1. 整体启动/停止HDFS

start-dfs/stop-dfs.sh

2. 整体启动/停止YARN

start-yarn/stop-yarn.sh

• 各个服务组件统一启动/停止

2. 分别启动/停止HDFS组件

hdfs --daemon start/stop namenode/datanode/secondarynamenode

4. 启动/停止YARN

yarn --daemon start/stop resourcemanager/nodemanager

hadoop常用脚本

1. hadoop集群启停脚本（包含HDFS，Yarn，Historyserver）：myhadoop.sh

• 切换到bin目录下创建该文件并输入以下内容

#!/bin/bash

if [ $# -lt 1 ]
then
	echo "No Args Input..."
	exit ;
fi

chse $1 in 
"start")
	echo " ==================== 启动 hadoop集群 ===================="
	echo " --------------- 启动 hdfs ---------------"
	ssh hadoop102 "/opt/module/hadoop-2.7.2/sbin/start-dfs.sh"
	echo " --------------- 启动 yarn ---------------"
	ssh hadoop103 "/opt/module/hadoop-2.7.2/sbin/start-yarn.sh"
	echo " --------------- 启动 historyserver ---------------"
	#ssh hadoop102 "/opt/module/hadoop-2.7.2/bin/mapred --daemon start historyserver"
	ssh hadoop102 "/opt/module/hadoop-2.7.2/bin/mr-jobhistory-daemon.sh start historyserver"
;;
"stop")
	echo " ==================== 关闭 hadoop集群 ===================="
	echo " --------------- 关闭 historyserver ---------------"
	#ssh hadoop102 "/opt/module/hadoop-2.7.2/bin/mapred --daemon stop historyserver"
	ssh hadoop102 "/opt/module/hadoop-2.7.2/bin/mr-jobhistory-daemon.sh start historyserver"
	echo " --------------- 关闭 yarn ---------------"
	ssh hadoop103 "/opt/module/hadoop-2.7.2/sbin/stop-yarn.sh"
	echo " --------------- 关闭 hdfs ---------------"
	ssh hadoop102 "/opt/module/hadoop-2.7.2/sbin/stop-dfs.sh"
;;
*)
echo "input Args Error..."
;;
esac

• 修改权限

[amelia@hadoop102 bin]$ chmod 777 myhadoop.sh

• 查看jps
• 打开集群

[amelia@hadoop102 hadoop-2.7.2]$ myhadoop.sh start

• 再jps
• 关闭集群

[amelia@hadoop102 hadoop-2.7.2]$ myhadoop.sh stop

2. 查看三台服务器Java进程脚本：jspall

• 切换到bin目录下创建该文件并输入以下内容

#!/bin/bash

for host in hadoop102 hadoop103 hadoop104
do 
	echo =============== $host ===============
	ssh $host jps
done 

• 修改权限

[amelia@hadoop102 bin]$ chmod 777 jpssll

• 分发脚本

[amelia@hadoop102 hadoop-2.7.2]$ xsync /home/amelia/bin/