在linux上安装Kafka,步骤如下:
第一步:安装Java jdk
1.到官网复制下载链接
官网地址:
http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html
2.在xshell上输入命令
wget --no-check-certificate --no-cookies --header "Cookie: oraclelicense=accept-securebackup-cookie"
后面加上刚才复制的下载链接
示例如下:
wget --no-check-certificate --no-cookies --header "Cookie: oraclelicense=accept-securebackup-cookie"
http://download.oracle.com/otn-pub/java/jdk/8u181-b13/96a7b8442fe848ef90c96a2fad6ed6d1/jdk-8u181-linux-x64.tar.gz
3.下载完成之后解压
tar -zxvf jdk-8u151-linux-x64.tar.gz
4.编辑配置文件,配置环境变量
vim /etc/profile
添加如下内容:(JAVA_HOME根据实际目录来)
#set java environment
JAVA_HOME=/usr/local/jdk/jdk1.8.0_151
CLASSPATH=$JAVA_HOME/lib/
PATH=$PATH:$JAVA_HOME/bin
export PATH JAVA_HOME CLASSPATH
5.使配置生效:
重新加载配置文件,执行命令(推荐这种方式) :
source /etc/profile
或者,重启机器
sudo shutdown -r now
6.查看安装情况
java -version
安装成功,则出现java版本信息:
java version "1.8.0_151"
Java(TM) SE Runtime Environment (build 1.8.0_151-b01)
Java HotSpot(TM) 64-Bit Server VM (build 25.151-b01, mixed mode)
第二步:安装zookper:
1. 到官网查看下载的版本
下载地址:
https://mirrors.cnnic.cn/apache/zookeeper/stable/
2.下载命令:
wget https://mirrors.cnnic.cn/apache/zookeeper/stable/zookeeper-3.4.12.tar.gz
3.解压缩指定目录(/home/work/soft/)
tar -zxvf zookeeper-3.4.12.tar.gz
4.修改配置文件:
# 复制一份zoo_sample.cfg文件,并改名为zoo.cfg
sudo cp home/work/soft/zookeeper/zoo_sample.cfg zoo.cfg
# 编辑zoo.cfg 文件
sudo vim home/work/soft/zookeeper/zoo.cfg
#主要修改dataDir和server.1=127.0.0.1:2888:3888这2处
# the directory where the snapshot is stored.
dataDir=home/work/soft/zookeeper/data
# the port at which the clients will connect
clientPort=2181
server.1=127.0.0.1:2888:3888
5.启动zookeeper:
/home/work/soft/zookeeper-3.4.12/bin/zkServer.sh start /home/work/soft/zookeeper-3.4.12/conf/zoo.cfg &
第三步:安装kafka2.12
1. 到官网查看下载的版本
下载地址:
http://mirror.bit.edu.cn/apache/kafka/2.0.0/
2.下载命令:
wget http://mirror.bit.edu.cn/apache/kafka/2.0.0/kafka_2.12-2.0.0.tgz
3.解压缩指定目录(/home/work/soft/)
tar -zxvf kafka_2.12-2.0.0.tgz
4.修改配置文件:
#创建日志存放目录
cd /home/work/soft/kafka/
mkdir -p log/kafka
#修改配置文件 /home/work/soft/kafka/config/server.properties
sudo vim /home/work/soft/kafka/config/server.properties
#主要修改下面几项内容如下:
broker.id=181
delete.topic.enable=true
listeners = PLAINTEXT://127.0.0.1:9092
log.dirs=/home/work/soft/kafka/log/kafka
zookeeper.connect=127.0.0.1:2181
5.启动kafka:
/home/work/soft/kafka_2.12-2.0.0/bin/kafka-server-start.sh /home/work/soft/kafka_2.12-2.0.0/config/server.properties &
6. 创建1个topic:
cd /home/work/soft/kafka_2.12-2.0.0
bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test_log
7. 列出topic:
bin/kafka-topics.sh --list --zookeeper localhost:2181
8. 生产者:
bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test_log
9. 消费者:
从一个topic上取消息
bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test_log --from-beginning
参考资料:
https://www.cnblogs.com/Yang2012/p/8078586.html
https://blog.csdn.net/shubingzhuoxue/article/details/82868956