NSQ的安装运行以及编程实践

NSQ的安装运行以及编程实践

配置Golang环境

下载标准安装包

https://golang.org/dl/

解压到/usr/local目录sudo tar -xzvf go1.5.2.linux-amd64.tar.gz /usr/local

在$HOME目录下创建文件夹gopath

在~/.bashrc添加如下内容，并source .bashrc

export GOPATH=$HOME/gopath
export PATH=$PATH:/usr/local/go/bin:$GOPATH/bin

源码安装nsq

依次执行如下步骤

go get github.com/tools/godep
go get github.com/bmizerany/assert
godep get github.com/bitly/nsq/...

godep执行之后，如果报错：

godep: outdated Godeps missing source code
This dependency list was created with an old version of godep.
To work around this, you have two options:
1. Run ‘godep restore‘, and try again.
2. Ask the maintainer to switch to a newer version of godep,
then try again with the updated package.

解决办法

cd src/github.com/bitly/nsq
rm Godeps
godep save ./...
godep get github.com/bitly/nsq/...

部署测试

依次在不同终端执行如下命令 

启动nsqlookupd

nsqlookupd

启动nsqd

nsqd --lookupd-tcp-address=127.0.0.1:4160

启动nsqadmin

nsqadmin --lookupd-http-address=127.0.0.1:4161

向nsqd发送消息

curl -d "hello world 1" "http://127.0.0.1:4151/put?topic=test"

启动nsq_to_file

nsq_to_file --topic=test --output-dir=/home/root --lookupd-http-address=127.0.0.1:4161

向nsqd发送消息

curl -d "hello world 2" "http://127.0.0.1:4151/put?topic=test"

向nsqd发送消息

curl -d "hello world 3" "http://127.0.0.1:4151/put?topic=test"

nsqlookupd是枢纽。nsqd是接受和转发消息的服务。nsqadmin是用于查看转态的web服务。nsq_to_file是消息的消费者。消息可以由nsqd经过nsqlookup来转发，也可以nsqd之间之间转发。 curl -d是以http的post方式向nsqd发出消息。 

nsq编程测试

以python代码示例 

安装pynsq

pip install pynsq

启动nsq服务

nsqlookupd
nsqd --lookupd-tcp-address=127.0.0.1:4160

生产者：

import nsq
import tornado.ioloop
import time

def pub_message():
    writer.pub('test', time.strftime('%H:%M:%S'), finish_pub)

def finish_pub(conn, data):
    print "It is ", data

reconnect_interval = 10.0
writer = nsq.Writer(nsqd_tcp_addresses=['127.0.0.1:4150'],
                            reconnect_interval=reconnect_interval,
                            name='test')

tornado.ioloop.PeriodicCallback(pub_message, 3000).start()
nsq.run()

生产者端将输出如下信息

It is  OK
It is  OK
It is  OK
It is  OK
...

消费者

import nsq
from pprint import pprint

def handler(message):
    print message.body
    return True

r = nsq.Reader(message_handler=handler,
        lookupd_http_addresses=['127.0.0.1:4161'],
        topic='test', channel='t1', lookupd_poll_interval=15)
nsq.run()

消费者端将输出如下信息

16:49:59
16:50:02
16:50:05
16:50:08
...

Comments