如果想创建一个 Storm 集群,有如下两种途径:
-
使用 storm-deploy在 Amazon EC2创建一个集群,如第六章所示
-
手动安装Storm(本节的内容)
手动安装Storm,需要安装如下软件:
-
Zookeeper 集群,参见管理手册
-
Java 6.0
-
Python 2.6.6
-
Unzip 指令
上述所有要安装的软件,是 Nimbus 和监控程序所需要的。
当安装了上述软件后,请安装本地库。
安装 ZeroMQ,运行:
<span class="line-number" style="margin:0px; padding:0px">1</span> <span class="line-number" style="margin:0px; padding:0px">2</span> <span class="line-number" style="margin:0px; padding:0px">3</span> <span class="line-number" style="margin:0px; padding:0px">4</span> <span class="line-number" style="margin:0px; padding:0px">5</span> <span class="line-number" style="margin:0px; padding:0px">6</span> | |
安装JZMQ,运行:
<span class="line-number" style="margin:0px; padding:0px">1</span> <span class="line-number" style="margin:0px; padding:0px">2</span> <span class="line-number" style="margin:0px; padding:0px">3</span> <span class="line-number" style="margin:0px; padding:0px">4</span> <span class="line-number" style="margin:0px; padding:0px">5</span> <span class="line-number" style="margin:0px; padding:0px">6</span> | |
一旦安装了本地库,下载稳定版的Storm并解压。
修改配置文件,增加你的Storm 集群配置。(所有默认配置可以在Storm 的 defaults.yaml 文件中看到)
编辑 conf/storm.yaml
文件来修改storm 集群配置:
<span class="line-number" style="margin:0px; padding:0px">1</span> <span class="line-number" style="margin:0px; padding:0px">2</span> <span class="line-number" style="margin:0px; padding:0px">3</span> <span class="line-number" style="margin:0px; padding:0px">4</span> <span class="line-number" style="margin:0px; padding:0px">5</span> <span class="line-number" style="margin:0px; padding:0px">6</span> <span class="line-number" style="margin:0px; padding:0px">7</span> <span class="line-number" style="margin:0px; padding:0px">8</span> <span class="line-number" style="margin:0px; padding:0px">9</span> <span class="line-number" style="margin:0px; padding:0px">10</span> <span class="line-number" style="margin:0px; padding:0px">11</span> <span class="line-number" style="margin:0px; padding:0px">12</span> <span class="line-number" style="margin:0px; padding:0px">13</span> | |
配置解释如下:
-
storm.zookeeper.servers :zookeeper 服务器的地址
-
storm.local.dir :Storm 存储内部处理数据的本地目录