Kafka Zookeeper 单节点测试

启动单节点Zookeeper Kafka，主要用来做测试使用。

 

1. Zookeeper

阿里镜像站

这里以 zookeeper-3.4.14 为例

1. 下载、上传、解压

tar -zxvf zookeeper-3.4.14.tar.gz
mv zookeeper-3.4.14 /opt/apps/

2. 配置环境变量

vim ~/.bashrc

#zookeeper
export ZOOKEEPER_HOME=/opt/apps/zookeeper-3.4.14
export PATH=$PATH:$ZOOKEEPER_HOME/bin

source ~/.bashrc

3. 修改 datadir

cd /zookeeper-3.4.14/conf
cp zoo_sample.cfg zoo.cfg
vim zoo.cfg

dataDir=/opt/apps/zookeeper-3.4.14/data

4. 启动

# start、status、stop
zkServer.sh start

jps
zkServer.sh status

 

2. Kafka

阿里镜像站

这里以kafka_2.11-2.1.1为例。Kafka 有自带 Zookeeper，可以使用单独安装的 Zookeeper。

1. 下载、上传、解压

tar -zxvf kafka_2.11-2.1.1.tgz
mv kafka_2.11-2.1.1 /opt/apps/

2. 配置环境变量

vim ~/.bashrc

#zookeeper
export KAFKA_HOME=/opt/apps/kafka_2.11-2.1.1
export PATH=$PATH:$KAFKA_HOME/bin

source ~/.bashrc

3. 启动内置 Zookeeper

vim $KAFKA_HOME/config/zookeeper.properties

# 修改 Zookeeper 文件目录,端口可以不修改,或根绝实际情况修改
dataDir=/opt/apps/kafka_2.11-2.1.1/zookeeper/data


# 开启 Kafka 内置 Zookeeper
zookeeper-server-start.sh $KAFKA_HOME/config/zookeeper.properties
# 后台
nohup zookeeper-server-start.sh $KAFKA_HOME/config/zookeeper.properties > $KAFKA_HOME/logs/zookeeper.log 2>&1 &

 4. 修改配置

vim server.properties

# 修改日志目录
log.dirs=/opt/apps/kafka_2.11-2.1.1/kafka-logs

5. 启动

kafka-server-start.sh config/server.properties

# 后台
nohup kafka-server-start.sh $KAFKA_HOME/config/server.properties > $KAFKA_HOME/logs/kafka.log 2>&1 &

6. Kafka-shell

# 创建 topic
kafka-topics.sh \
--create \
--zookeeper hadoop-master:2181 \
--replication-factor 1 \
--partitions 1 \
--topic topic_sdk_log

# 显示 topic 详细
kafka-topics.sh \
--describe \
--zookeeper hadoop-master:2181 \
--topic topic_sdk_log

# 显示所有 topic 
kafka-topics.sh \
--list \
--zookeeper hadoop-master:2181

# 创建 producer
kafka-console-producer.sh \
--broker-list localhost:9092 \
--topic topic_sdk_log

#创建 consumer
kafka-console-consumer.sh \
--zookeeper hadoop-master:2181 \
--topic topic_sdk_log\
--from-beginning

 

Flume单节点安装连接Kafka