1.2 kafka安装和配置
1.2.1 jdk环境
首先需要安装Java环境,同时配置环境变量
1.2.2 zookeeper安装
Zookeeper是安装Kafka集群的必要组件,Kafka通过Zookeeper来实施对元数据信息的管理,包括集 群、主题、分区等内容。 同样在官网下载安装包到指定目录解压缩
ZooKeeper 官网: Apache ZooKeeper
在今天提供的资料中,有一个zookeeper-3.4.14.tar.gz包,上传到服务器,也可以到官网上下载
(1)解压压缩包
<span style="background-color:#333333"><span style="color:#b8bfc6">tar zxvf zookeeper-3.4.14.tar.gz</span></span>
(2)修改配置文件,进入安装路径conf目录,并将zoo_sample.cfg文件修改为zoo.cfg
<span style="background-color:#333333"><span style="color:#b8bfc6"><span style="color:#f3b3f8">cd</span> zookeeper-3.4.14 <span style="color:#da924a">#进入安装目录</span>
<span style="color:#f3b3f8">cd</span> conf <span style="color:#da924a">#进入配置目录</span>
<span style="color:#f3b3f8">mv</span> zoo_sample.cfg zoo.cfg <span style="color:#da924a"># 把文件改名</span></span></span>
(3)创建存放数据的目录 data
在zookeeper安装的根目录创建目录 data
<span style="background-color:#333333"><span style="color:#b8bfc6"><span style="color:#f3b3f8">mkdir</span> data </span></span>
创建完的效果如下:
(4)配置数据存储目录
进入conf目录下,编辑zoo.cfg
<span style="background-color:#333333"><span style="color:#b8bfc6"><span style="color:#f3b3f8">vi</span> conf/zoo.cfg</span></span>
修改内容,如下图
(5)启动zookeeper
进入bin目录
<span style="background-color:#333333"><span style="color:#b8bfc6">./zkServer.sh <span style="color:#f3b3f8">start</span> <span style="color:#da924a"># 启动</span>
./zkServer.sh status <span style="color:#da924a"># 查看状态</span>
./zkServer.sh <span style="color:#f3b3f8">restart</span> <span style="color:#da924a"># 重启</span>
./zkServer.sh <span style="color:#f3b3f8">stop</span> <span style="color:#da924a"># 关闭</span></span></span>
启动后可以查看进程
<span style="background-color:#333333"><span style="color:#b8bfc6">jps</span></span>
1.2.3 kafka安装
(1)官网下载
下载地址:Apache Kafka
也可以在今天的资源文件夹中找到这个安装,直接上传到服务器即可
(2)解压
<span style="background-color:#333333"><span style="color:#b8bfc6">tar zxvf kafka_2.12-2.2.1.tgz</span></span>
(3)修改参数
修改config目录下的server.properties文件,效果如下
-
修改listeners=PLAINTEXT://host:9092
-
log.dirs=/root/kafka_2.12-2.2.1/logs 需要在kafka安装目录新建logs目录
云服务器安装Kafka按照上面的配置,会报错:
[2021-12-30 18:06:14,872] ERROR [KafkaServer id=0] Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer) org.apache.kafka.common.KafkaException: Socket server failed to bind to 139.196.208.215:9092: 无法指定被请求的地址. at kafka.network.Acceptor.openServerSocket(SocketServer.scala:573) at kafka.network.Acceptor.<init>(SocketServer.scala:451) at kafka.network.SocketServer.createAcceptor(SocketServer.scala:245) at kafka.network.SocketServer.$anonfun$createDataPlaneAcceptorsAndProcessors$1(SocketServer.scala:215) at kafka.network.SocketServer.$anonfun$createDataPlaneAcceptorsAndProcessors$1$adapted(SocketServer.scala:214) at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62) at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55) at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49) at kafka.network.SocketServer.createDataPlaneAcceptorsAndProcessors(SocketServer.scala:214) at kafka.network.SocketServer.startup(SocketServer.scala:114) at kafka.server.KafkaServer.startup(KafkaServer.scala:253) at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38) at kafka.Kafka$.main(Kafka.scala:75) at kafka.Kafka.main(Kafka.scala) Caused by: java.net.BindException: 无法指定被请求的地址 at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Net.java:461) at sun.nio.ch.Net.bind(Net.java:453) at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:222) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:85) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:78) at kafka.network.Acceptor.openServerSocket(SocketServer.scala:569) ... 13 more
百度搜索后,采用下面的配置可成功~~~
需要的配置信息,如下:原博文链接云服务器搭建kafka的坑_苍鹰嘉措的博客-CSDN博客_云服务器配置kafka
broker.id=0 listeners=PLAINTEXT://0.0.0.0:9092 //0表示接收任何的ip advertised.host.name=云服务器公网弹性IP//必要设置 advertised.port=9092 zookeeper.connect=0.0.0.0:2181 //zookeeper在配置的时候,本机的地址是要用0.0.0.0去替代弹性公网IP地址 ———————————————— 版权声明:本文为CSDN博主「苍鹰嘉措」的原创文章,遵循CC 4.0 BY-SA版权协议,转载请附上原文出处链接及本声明。 原文链接:云服务器搭建kafka的坑_苍鹰嘉措的博客-CSDN博客_云服务器配置kafka
(4)启动kafka
在kafka的根目录
<span style="background-color:#333333"><span style="color:#b8bfc6">bin/kafka-server-start.sh config/server.properties <span style="color:#da924a">#启动kafka</span></span></span>
查看进程
注意:启动kafka之前,必须先启动zookeeper