![](https://img-blog.csdnimg.cn/20201014180756927.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
kafka
wangan094
这个作者很懒,什么都没留下…
展开
-
Offset Explorer ( Kafka消息可视化工具)配置连接
file --> Add New ConnectionProperties:Advanced:如果是在云服务器中,需要外网访问,则需要配置advertised.listeners等,不需要配置Advanced里的9092地址如果是内网中访问,不需要配置advertised.listeners等,但需要配置Advanced里的9092地址否则会导致连接不上。...原创 2021-09-22 15:56:05 · 12457 阅读 · 0 评论 -
kafka报错:The Cluster ID doesn‘t match stored clusterId Some in meta.properties
kafka启动报错:ERROR Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)kafka.common.InconsistentClusterIdException: The Cluster ID kVSgfurUQFGGpHMTBqBPiw doesn't match stored clusterId Some(0Qftv9yBTAmf2iDPSlIk7g) in meta.原创 2021-09-18 10:30:42 · 12726 阅读 · 3 评论 -
kafka报错:InvalidReceiveException: Invalid receive (size = 1195725856 larger than 104857600)
将$KAFKA_HOME/config/server.properties文件中的socket.request.max.bytes值重置为超过数据包大小,然后重新启动kafka服务器。将socket.request.max.bytes翻倍。原创 2021-09-14 10:41:41 · 4937 阅读 · 0 评论 -
单机版和zookeeper集群版创建和订阅kafka消息命令
单机版:./bin/kafka-console-producer.sh --bootstrap-server 172.31.51.74:9092 --topic student_1./bin/kafka-console-consumer.sh --bootstrap-server 172.31.51.74:9092 --topic student_1 --from-beginning集群版:./bin/kafka-topics.sh --create --zookeeper 192.168原创 2021-09-01 19:28:56 · 154 阅读 · 0 评论 -
kafka启动及停止脚本
在$KAFKA_HOME/bin下新建如下脚本文件start-kafka.sh #!/bin/bash BROKERS="cluster1 cluster2 cluster3" APPHOME="/usr/local/kafka_2.10-0.8.2.1" APP_NAME="kafka_2.10-0.8.2.1" for i in $BROKERS do echo "Starting ${APP_NAME} on ${i} "原创 2021-08-02 15:20:36 · 766 阅读 · 0 评论 -
kafka安装配置及相关操作命令
一、安装配置:1、官网下载kafka对应版本:kafka_2.11-2.4.1http://kafka.apache.org/downloads2、解压缩:tar -zxvfjdk-8u131-linux-x64.tar.gz-C/usr/local/java3、修改配置文件:(1)vi zookeeper.properties,#配置数据文件保存路径dataDir=/root/software/kafka_2.11-2.4.1/datadir(2)vi server.pr...原创 2020-08-03 15:11:45 · 317 阅读 · 0 评论 -
云服务器(阿里云)安装kafka及相关报错处理(WARN Connection request from old client /58.247.201.56:31365; will be dropp)
云服务器安装kafka,部署zookeeper时有如下注意点:1、在云服务器安全组中开放:2181、9092端口2、zookeeper.connect改成公网IP3、listeners=PLAINTEXT:// 必须填内网IPlisteners=PLAINTEXT://**.**.**.**:90924、配置外部代理地址必须填公网IPadvertised.listeners=PLAINTEXT://**.**.**.**:9092advertised.host.name=*..原创 2021-09-01 18:55:31 · 4348 阅读 · 0 评论 -
Offset Explorer ( Kafka消息可视化工具)乱码
解决办法:根据代码的实际情况,设置成对应的值。设置完成后点update、refresh更新原创 2021-08-21 01:28:18 · 3457 阅读 · 1 评论