大数据学习系列10-Centos6.7下storm-0.9.5集群安装部署

qingwax-bk

于 2019-10-06 17:08:47 发布

阅读量157

点赞数

本文链接：https://blog.csdn.net/wademylove/article/details/82795999

版权

集群规划

主机 IP 安装的软件运行的进程

mini1 192.168.33.61 jdk、storm nimbus、core

mini2 192.168.33.62 jdk、storm、zookeeper supervisor、QuorumPeerMain

mini3 192.168.33.63 jdk、storm、zookeeper supervisor、QuorumPeerMain

mini4 192.168.33.64 jdk、storm、zookeeper supervisor、QuorumPeerMain

1、下载安装包
从apache官网下载 http://storm.apache.org/downloads.html

2、解压安装包
tar -zxvf apache-storm-0.9.5.tar.gz -C /home/hadoop/export/servers/
cd /home/hadoop/export/servers/
ln -s apache-storm-0.9.5 storm
3、修改配置文件
mv /home/hadoop/export/servers/storm/conf/storm.yaml /home/hadoop/export/servers/storm/conf/storm.yaml.bak
vi /home/hadoop/export/servers/storm/conf/storm.yaml
输入以下内容：

#指定storm使用的zk集群
storm.zookeeper.servers:
- "mini2"
- "mini3"
- "mini4"
#指定storm本地状态保存地址
storm.local.dir: "/home/hadoop/export/data/storm/workdir"
#指定storm集群中的nimbus节点所在的服务器
nimbus.host: "mini1"
#指定nimbus启动JVM最大可用内存大小
nimbus.childopts: "-Xmx1024m"
#指定supervisor启动JVM最大可用内存大小
supervisor.childopts: "-Xmx1024m"
#指定supervisor节点上，每个worker启动JVM最大可用内存大小
worker.childopts: "-Xmx768m"
#指定ui启动JVM最大可用内存大小，ui服务一般与nimbus同在一个节点上。
ui.childopts: "-Xmx768m"
#指定supervisor节点上，启动worker时对应的端口号，每个端口对应槽，每个槽位对应一个worker
supervisor.slots.ports:
- 6700
- 6701
- 6702
- 6703

4、分发安装包
scp -r /home/hadoop/export/servers/apache-storm-0.9.5 mini2:/home/hadoop/export/servers

scp -r /home/hadoop/export/servers/apache-storm-0.9.5 mini3:/home/hadoop/export/servers

scp -r /home/hadoop/export/servers/apache-storm-0.9.5 mini4:/home/hadoop/export/servers
然后分别在各机器上创建软连接
cd /home/hadoop/export/servers/
ln -s apache-storm-0.9.5 storm
5、启动集群
l 在nimbus.host所属的机器上启动 nimbus服务
cd /home/hadoop/export/servers/storm/bin/
nohup ./storm nimbus &
l 在nimbus.host所属的机器上启动ui服务
cd /home/hadoop/export/servers/storm/bin/
nohup ./storm ui &
l 在其它个点击上启动supervisor服务
cd /home/hadoop/export/servers/storm/bin/
nohup ./storm supervisor &

查看进程