下载地址:http://mirror.bit.edu.cn/apache/kafka/1.1.0/kafka_2.12-1.1.0.tgz
安装以及启动kafka
步骤1:安装kafka
$tar -zxvf kafka_2.12-1.1.0.tgz
$ cd kafka_2.12-1.1.0.tgz
步骤2:配置server.properties
配置zookeeper(假设您已经安装了zookeeper,如果没有安装,请再网上搜索安装方法)
进入kafka安装工程根目录编辑
vim config/server.properties
修改属性 zookeeper.connect=ip:2181,ip2: 2181
步骤3:server.properties配置说明
kafka最为重要三个配置依次为:broker.id、log.dir、zookeeper.connect
kafka server端config/server.properties参数说明和解释如下:
(参考配置说明地址:http://blog.csdn.net/lizhitao/article/details/25667831)
#实际使用案例 这里211上面的kafka配置文件
broker.id=1
port=9092
host.name=192.168.1.211
num.network.threads=2
num.io.threads=8
socket.send.buffer.bytes=1048576
socket.receive.buffer.bytes=1048576
socket.request.max.bytes=104857600
log.dirs=/tmp/kafka-logs
num.partitions=2
log.retention.hours=168
log.segment.bytes=536870912
log.retention.check.interval.ms=60000
log.cleaner.enable=false
zookeeper.connect=192.168.1.213:2181,192.168.1.216:2181,192.168.1.217:2181
zookeeper.connection.timeout.ms=1000000
#kafka实际使用案例 210服务器kafka配置
broker.id=2
port=9092
host.name=192.168.1.210
num.network.threads=2
num.io.threads=8
socket.send.buffer.bytes=1048576
socket.receive.buffer.bytes=1048576
socket.request.max.bytes=104857600
log.dirs=/tmp/kafka-logs
num.partitions=2
log.retention.hours=168
log.segment.bytes=536870912
log.retention.check.interval.ms=60000
log.cleaner.enable=false
zookeeper.connect=192.168.1.213:2181,192.168.1.216:2181,192.168.1.217:2181
zookeeper.connection.timeout.ms=1000000
步骤4: 启动kafka
(先启动zookeeper $: bin/zkServer.sh start config/zookeeper.properties &)
cd kafka-0.8.1
$ bin/kafka-server-start.sh -daemon config/server.properties &
(实验时,需要启动至少两个broker bin/kafka-server-start.sh -daemon config/server-1.properties &)
步骤5:创建topic
$ bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor1 --partitions1 --topic test
步骤6:验证topic是否创建成功
$ bin/kafka-topics.sh --list --zookeeper localhost:2181
localhost为zookeeper地址
topic描述:
bin/kafka-topics.sh --describe --zookeeper192.168.1.8:2181 --topic test
步骤7:查看topic
bin/kafka-topics.sh--create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test
步骤8:发送消息
bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
步骤9:接收消息
bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic test --from-beginning