Kafka安装与配置
相关博客:Kafka操作命令
1. 编译安装Kafka
安装与配置Scala运行环境,安装与配置Gradle编译工具
gradle -version
gradlew clean && gradlew relaeseTarGz
2. 二进制文件安装Kafka
下载地址:Kafka官网
2.1. Kafka单机安装
第一步:【建议使用zookeeper集群,本例使用kafka自带zookeeper】
后台启动zookeeper(推荐)
./zookeeper-server-start.sh ../config/zookeeper.properties 1>/dev/null 2>&1 &
第二步:启停脚本
后台启动kafka
config/server1.properties:
broker.id=0
listeners=PLAINTEXT://192.168.1.130:9092
log.dirs=kafka-logs
zookeeper.connect=localhost:2181
./kafka-server-start.sh ../config/server.properties 1>/dev/null 2>&1 &
/usr/local/kafka/bin/zookeeper-server-start.sh /usr/local/kafka/config/zookeeper.properties &
/Intelligent/applications/mq/kafka_2.12-2.0.0/bin/kafka-server-start.sh /Intelligent/applications/mq/kafka_2.12-2.0.0/config/server.properties &
nohup ./kafka-server-start.sh ../config/server.properties > kafka-server-start.log 2>&1 &
第三步:检测2181与9092端口
netstat -tunlp|egrep "(2181|9092)"
第四步:Kafka单机伪集群的配置
设置多个broker集群(单机伪集群的配置)
cp config/server.properties config/server-0.properties
config/server-0.properties:
broker.id=0
listeners=PLAINTEXT://192.168.1.130:9092
log.dirs=kafka-logs
zookeeper.connect=localhost:2181
cp config/server.properties config/server-1.properties
config/server-1.properties:
broker.id=1
listeners=PLAINTEXT://192.168.1.130:9093
log.dirs=kafka-logs-1
zookeeper.connect=localhost:2181
cp config/server.properties config/server-2.properties
config/server-2.properties:
broker.id=2
listeners=PLAINTEXT://192.168.1.130:9094
log.dirs=kafka-logs-2
zookeeper.connect=localhost:2181
2.2. Kafka分布式安装(推荐:生产环境)
2.2.1. zookeeper安装配置
分布式zookeeper配置
zookeeper 配置
/conf/zoo.cfg
tickTime=2000
initLimit=10
syncLimit=5
dataDir=/Intelligent/applications/zookeeper-3.4.6/data
dataLogDir=/Intelligent/applications/zookeeper-3.4.6/logs