1.Spark
启动 Spark Master 和 Slaves, 以及 HistoryServer
cd /export/servers/spark
sbin/start-all.sh
sbin/start-history-server.sh
停止 Spark 集群
cd /export/servers/spark
sbin/stop-all.sh
sbin/stop-history-server.sh
单独再启动一个 Master
cd /export/servers/spark
sbin/start-master.sh
附录:Spark各服务端口
Service port
Master WebUI node01:8080
Worker WebUI node01:8081
History Server node01:4000
启动 Spark shell
cd /export/servers/spark
bin/spark-shell --master local[2]
2.Flink
启动Flink集群
cd /export/servers/flink-1.7.2
./bin/start-cluster.sh
#standalone模式的集群启动
启动/停止flink集群
- 启动:./bin/start-cluster.sh
- 停止:./bin/stop-cluster.sh
启动/停止jobmanager
如果集群中的jobmanager进程挂了,执行下面命令启动
- bin/jobmanager.sh start
- bin/jobmanager.sh stop
启动/停止taskmanager
添加新的taskmanager节点或者重启taskmanager节点
- bin/taskmanager.sh start
- bin/taskmanager.sh stop