Linux 安装kafka

 

下载地址：https://www.apache.org/dyn/closer.cgi?path=/kafka/0.8.1.1/kafka_2.10-0.8.1.1.tgz

安装以及启动kafka

步骤1：安装kafka

 $tar -xzf kafka_2.10-0.8.1.1.tgz

$ cd kafka_2.10-0.8.1.1.tgz

 

步骤2：配置server.properties

 配置zookeeper(假设您已经安装了zookeeper,如果没有安装，请再网上搜索安装方法)

进入kafka安装工程根目录编辑 

vim config/server.properties  

修改属性 zookeeper.connect=ip:2181,ip2: 2181

 

步骤3：server.properties配置说明

kafka最为重要三个配置依次为：broker.id、log.dir、zookeeper.connect

kafka server端config/server.properties参数说明和解释如下:

（参考配置说明地址：http://blog.csdn.net/lizhitao/article/details/25667831）

#实际使用案例 这里211上面的kafka配置文件

broker.id=1

port=9092

host.name=192.168.1.211

num.network.threads=2

num.io.threads=8

socket.send.buffer.bytes=1048576

socket.receive.buffer.bytes=1048576

socket.request.max.bytes=104857600

log.dirs=/tmp/kafka-logs

num.partitions=2

log.retention.hours=168

log.segment.bytes=536870912

log.retention.check.interval.ms=60000

log.cleaner.enable=false

zookeeper.connect=192.168.1.213:2181,192.168.1.216:2181,192.168.1.217:2181

zookeeper.connection.timeout.ms=1000000

#kafka实际使用案例 210服务器kafka配置

broker.id=2

port=9092

host.name=192.168.1.210

num.network.threads=2

num.io.threads=8

socket.send.buffer.bytes=1048576

socket.receive.buffer.bytes=1048576

socket.request.max.bytes=104857600

log.dirs=/tmp/kafka-logs

num.partitions=2

log.retention.hours=168

log.segment.bytes=536870912

log.retention.check.interval.ms=60000

log.cleaner.enable=false

zookeeper.connect=192.168.1.213:2181,192.168.1.216:2181,192.168.1.217:2181

zookeeper.connection.timeout.ms=1000000 

步骤4： 启动kafka

(先启动zookeeper $:  bin/zkServer.sh start config/zookeeper.properties &)

cd kafka-0.8.1

$ bin/kafka-server-start.sh -daemon config/server.properties &

 (实验时,需要启动至少两个broker   bin/kafka-server-start.sh -daemon config/server-1.properties &) 

步骤5：创建topic

$ bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor1 --partitions1 --topic test

步骤6：验证topic是否创建成功

 

$ bin/kafka-topics.sh --list --zookeeper localhost:2181

localhost为zookeeper地址 

topic描述：

bin/kafka-topics.sh --describe --zookeeper192.168.1.8:2181 --topic test

步骤7：查看topic

 

bin/kafka-topics.sh--create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test

步骤8：发送消息

 

bin/kafka-console-producer.sh  --zookeeper localhost:2181 --topic test

步骤9：接收消息

 

bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic test --from-beginning