kafka搭建

1、下载Kafka并解压
下载:
curl -L -O http://mirrors.cnnic.cn/apache/kafka/0.9.0.0/kafka_2.10-0.9.0.0.tgz
或
wget http://mirrors.shu.edu.cn/apache/kafka/2.0.0/kafka_2.12-2.0.0.tgz
解压：
tar zxvf ./kafka_2.12-2.0.0.tgz

启动zookeeper
nohup /home/ganges/kafka_2.12-2.0.0/bin/zookeeper-server-start.sh /home/ganges/kafka_2.12-2.0.0/config/zookeeper.properties &
或者
bin/zookeeper-server-start.sh -daemon config/zookeeper.properties
启动kafka
nohup /home/ganges/kafka_2.12-2.0.0/bin/kafka-server-start.sh /home/ganges/kafka_2.12-2.0.0/config/server.properties &
或者
bin/kafka-server-start.sh -daemon config/server.properties

查看所有主题
/home/ganges/kafka_2.12-2.0.0/bin/kafka-topics.sh --zookeeper 127.0.0.1:2181 --list
创建topic
/home/ganges/kafka_2.12-2.0.0/bin/kafka-topics.sh --create --zookeeper 127.0.0.1:2181 --replication-factor 1 --partitions 1 --topic TestTopic1
删除topic
/home/ganges/kafka_2.12-2.0.0/bin/kafka-topics.sh --zookeeper 127.0.0.1:2181 --delete --topic test001
关闭服务
/home/ganges/kafka_2.12-2.0.0/bin/kafka-server-stop.sh

查看topic消费到的offset
/home/ganges/kafka_2.12-2.0.0/bin/kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.72.66.140:9092 --topic test --time -1
生产者：
/home/ganges/kafka_2.12-2.0.0/bin/kafka-console-producer.sh --broker-list 10.72.66.140:9092 --topic test
消费者：
/home/ganges/kafka_2.12-2.0.0/bin/kafka-console-consumer.sh --bootstrap-server 10.72.66.140:9092 --topic test --from-beginning
/home/ganges/kafka_2.12-2.0.0/bin/kafka-console-consumer.sh --bootstrap-server 10.72.66.140:9092 --topic test

查看对应topic的描述信息
/home/ganges/kafka_2.12-2.0.0/bin/kafka-topics.sh --describe --zookeeper 10.72.66.140:2181 --topic test

关闭kafka集群
ps aux|grep kafka|grep -v grep|awk ‘{print $2}’|xargs kill -9