grafana部署监控kafka和zookeeper

grafana，prometheus的安装见上一篇博客

1.下载kafka安装包和zookeeper安装包

kafka安装包

wget https://mirrors.tuna.tsinghua.edu.cn/apache/kafka/2.8.0/kafka_2.12-2.8.0.tgz

zookeeper安装包

wget https://archive.apache.org/dist/zookeeper/zookeeper-3.4.9/zookeeper-3.4.9.tar.gz

2.把kafka安装包解压到/opt/aspire/product/并重命名文件夹kafka，把zookeeper安装包解压到/usr/local/zookeeper并重命名文件夹zookeeper

tar zxvf kafka_2.12-2.8.0.tgz -C /opt/aspire/product/

mv kafka_2.12-2.8.0 kafka

tar zxvf zookeeper-3.4.9.tar.gz -C /usr/local/

mv zookeeper-3.4.9 zookeeper

3.修改kafka配置文件（ip地址根据实际填写）

sed -i 's$broker.id=0$broker.id=1$g' /opt/aspire/product/kafka/config/server.properties

sed -i 's$#listeners=PLAINTEXT://:9092$listeners=PLAINTEXT://192.168.59.133:9092$g' /opt/aspire/product/kafka/config/server.properties

sed -i 's$num.partitions=1$num.partitions=3$g' /opt/aspire/product/kafka/config/server.properties

sed -i 's$zookeeper.connect=localhost:2181$zookeeper.connect=192.168.59.133:2181$g' /opt/aspire/product/kafka/config/server.properties

sed -i 's$zookeeper.connection.timeout.ms=18000$zookeeper.connection.timeout.ms=60000$g' /opt/aspire/product/kafka/config/server.properties

 

4.启动kafka服务

cd /opt/aspire/product/kafka/bin

./kafka-server-start.sh -daemon ../config/server.properties

5.修改zookeeper配置文件

cd /usr/local/zookeeper/conf

cp zoo_sample.cfg zoo.cfg

vim zoo.cfg

6.启动zookeeper

cd /usr/local/zookeeper/bin

./zkServer.sh start

 

7.下载kafka_exporter

地址：https://github.com/danielqsj/kafka_exporter/releases/download/v1.2.0/kafka_exporter-1.2.0.linux-amd64.tar.gz

8.解压kafka_exporter到/opt/aspire/product/，并重命名文件夹为kafka

tar zxvf kafka_exporter-1.2.0.linux-amd64.tar.gz -C /opt/aspire/product/

mv kafka_exporter-1.2.0.linux-amd64 kafka_exporter

9.启动kafka_exporter

cd /opt/aspire/product/kafka_exporter

nohup ./kafka_exporter --kafka.server=192.168.59.133:9092 &

10.下载zookeeper_exporter,并启动zookeeper_exporter

mkdir -p /opt/aspire/product/zookeeper_exporter

cd /opt/aspire/product/zookeeper_exporter

wget https://github.com/carlpett/zookeeper_exporter/releases/download/v1.0.2/zookeeper_exporter

 chomd +x zookeeper_exporter

./zookeeper_exporter

11.修改prometheus配置文件，并重启prometheus

cd /opt/aspire/product/prometheus/

vim prometheus.yml

 

 pkill prometheus

nohup ./prometheus &

12.检查页面是否正常，http://localhost:9090/targets

13.将kafka和zookeeperp对接grafana

kafka对应的dashboardId是7589 ,zookeeper对应的dashboardId是10465

kafak对接grafana见以下截图

 

 

 

 zookeeper对接grafana见以下截图