Storm安装配置
Storm集群也依赖Zookeeper集群,要保证Zookeeper集群正常运行。Storm的安装配置比较简单,我们仍然使用下面3台机器搭建:
192.168.1.101 cdh1
192.168.1.102 cdh2
192.168.1.103 cdh3
首先,在cdh1节点上,执行如下命令安装:
cd /usr/local/
wget http://mirror.bit.edu.cn/apache/incubator/storm/apache-storm-0.9.2-incubating/apache-storm-0.9.2-incubating.tar.gz
tar xvzf apache-storm-0.9.2-incubating.tar.gz
ln -s /usr/local/apache-storm-0.9.2-incubating /usr/local/storm
chown -R storm:storm /usr/local/apache-storm-0.9.2-incubating /usr/local/storm
修改配置文件conf/storm.yaml,内容如下所示:
storm.zookeeper.servers:
- "cdh1"
- "cdh2"
- "cdh3"
storm.zookeeper.port: 2181
#
nimbus.host: "cdh1"
supervisor.slots.ports:
- 6700
- 6701
- 6702
- 6703
storm.local.dir: "/tmp/storm"
将配置好的安装文件,分发到其他节点上:
scp -r /usr/local/apache-storm-0.9.2-incubating/ cdh2:/usr/local/
scp -r /usr/local/apache-storm-0.9.2-incubating/ cdh3:/usr/local/
最后,在cdh2、cdh3节点上配置,执行如下命令
cd /usr/local/
ln -s /usr/local/apache-storm-0.9.2-incubating /usr/local/storm
chown -R storm:storm /usr/local/apache-storm-0.9.2-incubating /usr/local/storm
Storm集群的主节点为Nimbus,从节点为Supervisor,我们需要在cdh1上启动Nimbus服务,在从节点cdh2、cdh3上启动Supervisor服务:
bin/storm nimbus &
bin/storm supervisor &
为了方便监控,可以启动Storm UI,可以从Web页面上监控Storm Topology的运行状态,例如在cdh2上启动:
bin/storm ui &
这样可以通过访问http://cdh2:8080/来查看Topology的运行状况。