集群规划
主机 IP 安装的软件 运行的进程
mini1 192.168.33.61 jdk、storm nimbus、core
mini2 192.168.33.62 jdk、storm、zookeeper supervisor、QuorumPeerMain
mini3 192.168.33.63 jdk、storm、zookeeper supervisor、QuorumPeerMain
mini4 192.168.33.64 jdk、storm、zookeeper supervisor、QuorumPeerMain
1、下载安装包
从apache官网下载 http://storm.apache.org/downloads.html
2、解压安装包
tar -zxvf apache-storm-0.9.5.tar.gz -C /home/hadoop/export/servers/
cd /home/hadoop/export/servers/
ln -s apache-storm-0.9.5 storm
3、修改配置文件
mv /home/hadoop/export/servers/storm/conf/storm.yaml /home/hadoop/export/servers/storm/conf/storm.yaml.bak
vi /home/hadoop/export/servers/storm/conf/storm.yaml
输入以下内容:
#指定storm使用的zk集群
storm.zookeeper.servers:
- "mini2"
- "mini3"
- "mini4"
#指定storm本地状态保存地址
storm.local.dir: "/home/hadoop/export/data/storm/workdir"
#指定storm集群中的nimbus节点所在的服务器
nimbus.host: "mini1"
#指定nimbus启动JVM最大可用内存大小
nimbus.childopts: "-Xmx1024m"
#指定supervisor启动JVM最大可用内存大小
supervisor.childopts: "-Xmx1024m"
#指定supervisor节点上,每个worker启动JVM最大可用内存大小
worker.childopts: "-Xmx768m"
#指定ui启动JVM最大可用内存大小,ui服务一般与nimbus同在一个节点上。
ui.childopts: "-Xmx768m"
#指定supervisor节点上,启动worker时对应的端口号,每个端口对应槽,每个槽位对应一个worker
supervisor.slots.ports:
- 6700
- 6701
- 6702
- 6703
4、分发安装包
scp -r /home/hadoop/export/servers/apache-storm-0.9.5 mini2:/home/hadoop/export/servers
scp -r /home/hadoop/export/servers/apache-storm-0.9.5 mini3:/home/hadoop/export/servers
scp -r /home/hadoop/export/servers/apache-storm-0.9.5 mini4:/home/hadoop/export/servers
然后分别在各机器上创建软连接
cd /home/hadoop/export/servers/
ln -s apache-storm-0.9.5 storm
5、启动集群
l 在nimbus.host所属的机器上启动 nimbus服务
cd /home/hadoop/export/servers/storm/bin/
nohup ./storm nimbus &
l 在nimbus.host所属的机器上启动ui服务
cd /home/hadoop/export/servers/storm/bin/
nohup ./storm ui &
l 在其它个点击上启动supervisor服务
cd /home/hadoop/export/servers/storm/bin/
nohup ./storm supervisor &
查看进程
6、查看集群
访问nimbus.mini1:8080,即可看到storm的ui界面。
Storm集群安装完成!