storm环境部署篇1

环境说明：Centos6.5系统 

storm version:0.8.2

1.安装storm的依赖组件

a.java >= 1.6

b.python >=2.6

c.zookeeper

d. ZeroMq 2.1.7 --消息队列，C++写的

e: JZMQ 是ZeroMq的java语言绑定实现

2.安装步骤

    a. 在Centos6.5系统中安装java版本，并配置相关的环境变量JAVA_HOME,PATH等

[root@localhost ~]# java -version
openjdk version "1.8.0_131"
OpenJDK Runtime Environment (build 1.8.0_131-b11)
OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode)

    b.安装python

[root@localhost ~]# python
Python 2.6.6 (r266:84292, Aug 18 2016, 15:13:37) 
[GCC 4.4.7 20120313 (Red Hat 4.4.7-17)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> 

    c.zookeeper的安装(测试不配置相关的集群操作了):

下载相关的zookeeper安装包，解压到目录启动zk:

[root@localhost bin]# ./zkServer.sh  start
ZooKeeper JMX enabled by default
Using config: /study/zookeeper-3.4/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
[root@localhost bin]# 

验证zk是否启动成功

[root@localhost bin]# jps
2673 Jps
2655 QuorumPeerMain

或者是通过客户端来连接

[root@localhost bin]# ./zkCli.sh -server 127.0.0.1:2181Q
Connecting to 127.0.0.1:2181

d.安装ZeroMQ

下载zeromq-2.1.7 安装包，解压

[root@localhost zeromq-2.1.7]# ls
acinclude.m4  AUTHORS     builds     config     configure.in  COPYING.LESSER  foreign  INSTALL      Makefile.am  NEWS  README  tests       zeromq.spec
aclocal.m4    autogen.sh  ChangeLog  configure  COPYING       doc             include  MAINTAINERS  Makefile.in  perf  src     version.sh

执行 ./configure 之后会缺少相关的编译环境 
configure: error: Unable to find a working C++ compiler

安装 ： yum install gcc-c++

 再次执行: ./configure 之后提示

checking for sem_init in -lrt... yes
checking for uuid_generate in -luuid... no
configure: error: cannot link with -luuid, install uuid-dev.

执行：
 yum install e2fsprogs-devel
 yum install uuid-devel
 yum install libuuid-devel

再再次确认 ./configure 没有缺少相关的依赖包

make 
make install

e: 安装JZMQ

    注意在这里要配置(/etc/profile)：JAVA_HOME,CLASSPATH,PATH

export JAVA_HOME=/usr/lib/jvm/jre-1.8.0-openjdk.x86_64
export CLASSPATH=$JAVA_HOME/lib
PATH=$JAVA_HOME/bin:$ERLANG_HOME/bin:$PATH

source /etc/profile

./autogen.sh
./configure
make
make install

f:安装storm

https://www.storm-project.net/downloads.html

修改 conf/storm.yaml

 storm.zookeeper.servers:  
     - "192.168.162.129" # zk服务器的地址
#     - "server2"
# 
 nimbus.host: "192.168.162.129" # nimbus的服务器地址
# 
# 
# ##### These may optionally be filled in:
#    
## List of custom serializations
# topology.kryo.register:
#     - org.mycompany.MyTypet
#     - org.mycompany.MyType2: org.mycompany.MyType2Serializer
#
## List of custom kryo decorators
# topology.kryo.decorators:
#     - org.mycompany.MyDecorator
#
## Locations of the drpc servers
# drpc.servers:
#     - "server1"
#     - "server2"
~                                                                                                                                                                                                                    

查看如何启动storm 

[root@localhost storm-0.8.2]# ./bin/storm --help
Unknown command: [storm --help]
Commands:
	activate
	classpath
	deactivate
	dev-zookeeper
	drpc
	help
	jar
	kill
	list
	localconfvalue
	nimbus     #启动nimbuse
	rebalance
	remoteconfvalue
	repl
	shell
	supervisor #启动nimbus服务

    ui  # 启动监控控制台，默认的商品是8080

    version

Help: 
	help 
	help <command>

先要启动nimbus:

./bin/storm nimbus  > /study/storm/storm-0.8.2/logs/main.log  2>&1   &   -> 后台方式启动

查看一下nimbus是否启动成功：

[root@localhost storm-0.8.2]# jps
16708 nimbus
16487 QuorumPeerMain
16780 Jps

启动控制台：./bin/storm  ui

[root@localhost ~]# jps
16291 core  -> UI 控制台
16357 Jps

访问UI地址：http://192.168.162.129:8080/

停止storm topology

./bin/storm kill {topology name}

到此单台storm的安装部署就已经完成了，下一节继续讲storm的集群安装配置

收工~~~