基于Prometheus+Grafana搭建可视化监控服务 (一) Prometheus监控

最新推荐文章于 2024-07-31 13:00:00 发布
最新推荐文章于 2024-07-31 13:00:00 发布
阅读量1.3k 收藏 3
点赞数
分类专栏： 大数据 文章标签： 运维开发
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/yilushunfengli/article/details/126118793
版权

转发于：基于Prometheus+Grafana搭建可视化监控服务 (一) Prometheus监控

https://www.cnblogs.com/huligong1234/p/15142981.html

目录
基于Prometheus+Grafana搭建可视化监控服务 (一) Prometheus及Exporter安装
一、概述
二、安装Prometheus
2.1.安装Prometheus
2.2.将Promethues配置成系统服务
2.3.通过systemctl启动prometheus
2.4.prometheus界面
三、监控远程Linux主机
3.1.安装node_exporter
3.2.将node_exporter配置成系统服务
3.3.通过systemctl启动node_exporter
3.4.验证node_exporter
3.5.防火墙配置
3.6.Prometheus侧配置
3.6.1.prometheus.yml配置调整
3.6.2.校验配置正确性
3.6.3.重新加载配置
3.6.4.验证结果
四、监控MySQL
4.1.创建监控用账号
4.2.安装mysqld_exporter
4.4.将mysqld_exporter配置成系统服务
4.5.通过systemctl启动mysqld_exporter
4.6.验证mysqld_exporter
4.7.防火墙配置
4.8.Prometheus侧配置
4.8.1.prometheus.yml配置调整
4.8.2.校验配置正确性
4.8.3.重新加载配置
4.8.4.验证结果
五、监控Redis
5.1.安装redis_exporter
5.2.将redis_exporter配置成系统服务
5.3.通过systemctl启动redis_exporter
5.4.验证redis_exporter
5.5.防火墙配置
5.6.Prometheus侧配置
5.6.1.prometheus.yml配置调整
5.6.2.校验配置正确性
5.6.3.重新加载配置
5.6.4.验证结果
5.6.5 Redis集群监控配置示例
六、监控RabbitMQ
6.1.安装rabbitmq_prometheus
6.2.验证rabbitmq_prometheus
6.3.防火墙配置
6.4.Prometheus侧配置
6.4.1.prometheus.yml配置调整
6.4.2.校验配置正确性
6.4.3.重新加载配置
6.4.4.验证结果
七、监控Elasticsearch
7.1.安装elasticsearch_exporter
7.2.将elasticsearch_exporter配置成系统服务
7.3.通过systemctl启动elasticsearch_exporter
7.4.验证elasticsearch_exporter
7.5.防火墙配置
7.6.Prometheus侧配置
7.6.1.prometheus.yml配置调整
7.6.2.校验配置正确性
7.6.3.重新加载配置
7.6.4.验证结果
八、监控Kafka
8.1.安装kafka_exporter
8.2.将kafka_exporter配置成系统服务
8.3.通过systemctl启动kafka_exporter
8.4.验证kafka_exporter
8.5.防火墙配置
8.6.Prometheus侧配置
8.6.1.prometheus.yml配置调整
8.6.2.校验配置正确性
8.6.3.重新加载配置
8.6.4.验证结果
九、监控Doris
9.1.验证doris_prometheus
9.2.Prometheus侧配置
9.2.1.prometheus.yml配置调整
9.2.2.校验配置正确性
9.2.3.重新加载配置
9.2.4.验证结果
十、监控端口(HTTP/TCP等)
10.1.安装blackbox_exporter
10.2.将blackbox_exporter配置成系统服务
10.3.通过systemctl启动blackbox_exporter
10.4.Prometheus侧配置
10.4.1.prometheus.yml配置调整
10.4.2.校验配置正确性
10.4.3.重新加载配置
10.4.4.验证结果
十一、监控MongoDB
11.1.安装mongodb_exporter
11.2.将mongodb_exporter配置成系统服务
11.3.通过systemctl启动mongodb_exporter
11.4.验证mongodb_exporter
11.5.防火墙配置
11.6.Prometheus侧配置
11.6.1.prometheus.yml配置调整
附:其他参考资料
一、概述
Prometheus官网文档: https://prometheus.io/docs/introduction/overview/

各组件默认端口:
prometheus ：9090
node 默认端口：9091(原默认端口为9100,与elasticsearch端口冲突，故这里改为9091)
mysql_exporter默认端口：9104
redis_exporter 默认端口：9121
rabbitmq_prometheus 默认端口： 15692
elasticsearch_exporter 默认端口： 9114
kafka_exporter 默认端口： 9308
blackbox_exporter默认端口: 9115
mongodb_exporter 端口: 9216
alertmanager默认端口：9093

注意：
1.本文使用的各程序版本是当下最新版本，实际需要到官网去看是否有更新的版本，推荐使用最新版本。
2.本文Prometheus等程序安装及监控目标都为Linux环境(CentOS7)
3.Promethues支持pull和push两种方式，本文描述的是pull方式
4.exporter一般都部署在监控目标服务器上，blackbox_exporter则和prometheus部署在一起

二、安装Prometheus
2.1.安装Prometheus
[root@server ~]# cd /usr/local/src
[root@server src]# wget https://github.com/prometheus/prometheus/releases/download/v2.28.1/prometheus-2.28.1.linux-amd64.tar.gz
[root@server src]# mkdir -p /usr/local/prometheus/
[root@server src]# tar xvf prometheus-2.28.1.linux-amd64.tar.gz -C /usr/local/prometheus/
[root@server src]# mv /usr/local/prometheus/prometheus-2.28.1.linux-amd64/ /usr/local/prometheus/prometheus
2.2.将Promethues配置成系统服务
[root@server src]# vi /etc/systemd/system/prometheus.service
[Unit]
Description=Prometheus Server
Documentation=https://prometheus.io/docs/introduction/overview/
After=network.target

[Service]
Restart=on-failure
WorkingDirectory=/usr/local/prometheus/prometheus
ExecStart=/usr/local/prometheus/prometheus/prometheus
–config.file=/usr/local/prometheus/prometheus/prometheus.yml
–storage.tsdb.path=/usr/local/prometheus/prometheus/data
–storage.tsdb.retention.time=30d
ExecReload=/bin/kill -s HUP $MAINPID
ExecStop=/bin/kill -SIGINT $MAINPID
[Install]
WantedBy=multi-user.target
config.file指定配置文件地址
storage.tsdb.path指定数据文件目录
storage.tsdb.retention.time指定数据文件保留时间

Promethues提供了很多的命令行配置选项，可通过./prometheus -h进行查看

2.3.通过systemctl启动prometheus
[root@server src]# systemctl daemon-reload
[root@server src]# systemctl start prometheus
[root@server src]# systemctl status prometheus
[root@server src]# systemctl enable prometheus
[root@server src]# systemctl reload prometheus
2.4.prometheus界面
通过浏览器访问http://服务器IP:9090就可以访问到prometheus的主界面
http://192.168.1.100:9090/targets

三、监控远程Linux主机
https://github.com/prometheus/node_exporter/

3.1.安装node_exporter
[root@dbserver ~]# cd /usr/local/src
[root@dbserver src]# wget https://github.com/prometheus/node_exporter/releases/download/v1.2.0/node_exporter-1.2.0.linux-amd64.tar.gz
[root@dbserver src]# mkdir -p /usr/local/prometheus/
[root@dbserver src]# tar xvf node_exporter-1.2.0.linux-amd64.tar.gz -C /usr/local/prometheus/
[root@dbserver src]# mv /usr/local/prometheus/node_exporter-1.2.0.linux-amd64/ /usr/local/prometheus/node_exporter
3.2.将node_exporter配置成系统服务
[root@dbserver src]# vi /etc/systemd/system/node_exporter.service
[Unit]
Description=node_exporter Server
Documentation=https://prometheus.io/docs/introduction/overview/
After=network.target

[Service]
Restart=on-failure
WorkingDirectory=/usr/local/prometheus/node_exporter
ExecStart=/usr/local/prometheus/node_exporter/node_exporter
–web.listen-address=0.0.0.0:9101
ExecStop=/bin/kill -SIGINT $MAINPID

[Install]
WantedBy=multi-user.target
3.3.通过systemctl启动node_exporter
[root@dbserver src]# systemctl daemon-reload
[root@dbserver src]# systemctl start node_exporter
[root@dbserver src]# systemctl status node_exporter
[root@dbserver src]# systemctl enable node_exporter
3.4.验证node_exporter
[root@dbserver src]# curl “http://127.0.0.1:9101/metrics”
3.5.防火墙配置
[root@dbserver src]# firewall-cmd --permanent --add-port=9101/tcp
[root@dbserver src]# firewall-cmd --reload

#也可以限定仅能指定的IP访问
[root@dbserver src]# firewall-cmd --permanent --add-rich-rule=“rule family=“ipv4” source address=“192.168.1.100” port protocol=“tcp” port=“9101” accept”

#或可直接关闭防火墙
[root@dbserver src]# systemctl stop firewalld
[root@dbserver src]# systemctl disable firewalld

3.6.Prometheus侧配置
3.6.1.prometheus.yml配置调整
[root@dbserver src]# vi /usr/local/prometheus/prometheus/prometheus.yml
scrape_configs:

The job name is added as a label job=<job_name> to any timeseries scraped from this config.

  • job_name: ‘prometheus’

    metrics_path defaults to ‘/metrics’

    scheme defaults to ‘http’.

    static_configs:

    • targets: [‘127.0.0.1:9090’]

  • job_name: ‘node_exporter’
    static_configs:

    • targets: [‘192.168.1.100:9101’,‘192.168.1.101:9101’]
      labels:
      service: 服务A
    • targets: [‘192.168.1.102:9101’,‘192.168.1.103:9101’]
      labels:
      service: 服务B
      3.6.2.校验配置正确性
      [root@dbserver src]# /usr/local/prometheus/prometheus/promtool check config /usr/local/prometheus/prometheus/prometheus.yml
      3.6.3.重新加载配置
      [root@dbserver src]# systemctl reload prometheus
      3.6.4.验证结果
      访问http://ip:9090/targets查看

四、监控MySQL
https://github.com/prometheus/mysqld_exporter/

4.1.创建监控用账号
CREATE USER ‘exporter’@‘localhost’ IDENTIFIED BY ‘Exporter#123’;
GRANT PROCESS,RELOAD,REPLICATION CLIENT, SELECT ON . TO ‘exporter’@‘localhost’;
FLUSH PRIVILEGES;
4.2.安装mysqld_exporter
[root@dbserver ~]# cd /usr/local/src
[root@dbserver src]# wget https://github.com/prometheus/mysqld_exporter/releases/download/v0.13.0/mysqld_exporter-0.13.0.linux-amd64.tar.gz
[root@dbserver src]# mkdir -p /usr/local/prometheus/
[root@dbserver src]# tar xvf mysqld_exporter-0.13.0.linux-amd64.tar.gz -C /usr/local/prometheus/
[root@dbserver src]# mv /usr/local/prometheus/mysqld_exporter-0.13.0.linux-amd64/ /usr/local/prometheus/mysqld_exporter


### 4.3.增加配置文件
```shell
[root@dbserver src]# vi /usr/local/prometheus/mysqld_exporter/.my.cnf
[client]
user=exporter
password=Exporter#123
socket=/var/lib/mysql/mysql.sock
4.4.将mysqld_exporter配置成系统服务
[root@dbserver src]# vi /etc/systemd/system/mysqld_exporter.service
[Unit]
Description=mysqld_exporter Server
Documentation=https://github.com/prometheus/mysqld_exporter/
After=network.target

[Service]
Environment=DATA_SOURCE_NAME=exporter:Exporter#123@(localhost:3306)/
ExecStart=/usr/local/prometheus/mysqld_exporter/mysqld_exporter \
  --web.listen-address=0.0.0.0:9104 \
  --config.my-cnf=/usr/local/prometheus/mysqld_exporter/.my.cnf \
  --collect.binlog_size \
  --collect.slave_status \
  --collect.slave_hosts \
  --collect.engine_innodb_status \
  --collect.info_schema.processlist \
  --collect.info_schema.innodb_metrics \
  --collect.info_schema.innodb_tablespaces \
  --collect.info_schema.clientstats \
  --collect.perf_schema.tableiowaits \
  --collect.perf_schema.indexiowaits \
  --collect.perf_schema.tablelocks \
  --collect.perf_schema.file_events \
  --collect.perf_schema.eventswaits
ExecStop=/bin/kill -SIGINT $MAINPID
Restart=on-failure
[Install]
WantedBy=multi-user.target
4.5.通过systemctl启动mysqld_exporter
[root@dbserver src]# systemctl daemon-reload
[root@dbserver src]# systemctl start mysqld_exporter
[root@dbserver src]# systemctl status mysqld_exporter
[root@dbserver src]# systemctl enable mysqld_exporter
4.6.验证mysqld_exporter
[root@dbserver src]# curl "http://127.0.0.1:9104/metrics"
4.7.防火墙配置
[root@dbserver src]# firewall-cmd --permanent --add-port=9104/tcp
[root@dbserver src]# firewall-cmd --reload

#也可以限定仅能指定的IP访问
[root@dbserver src]# firewall-cmd --permanent --add-rich-rule="rule family="ipv4" source address="192.168.1.100" port protocol="tcp" port="9104" accept"

#或可直接关闭防火墙
[root@dbserver src]# systemctl stop firewalld
[root@dbserver src]# systemctl disable firewalld

4.8.Prometheus侧配置
4.8.1.prometheus.yml配置调整
[root@dbserver src]# vi /usr/local/prometheus/prometheus/prometheus.yml
scrape_configs:
  # The job name is added as a label `job=<job_name>` to any timeseries scraped from this config.
  - job_name: 'prometheus'

    # metrics_path defaults to '/metrics'
    # scheme defaults to 'http'.

    static_configs:
    - targets: ['127.0.0.1:9090']

  - job_name: 'mysql_exporter'
    static_configs:
    - targets: ['192.168.1.100:9104']
      labels:
        service: 服务A-MySQL
    - targets: ['192.168.1.101:9104']
      labels:
        service: 服务B-MySQL
4.8.2.校验配置正确性
[root@dbserver src]# /usr/local/prometheus/prometheus/promtool check config /usr/local/prometheus/prometheus/prometheus.yml 
4.8.3.重新加载配置
[root@dbserver src]# systemctl reload prometheus
4.8.4.验证结果
访问http://ip:9090/targets查看

五、监控Redis
https://github.com/oliver006/redis_exporter/

5.1.安装redis_exporter
[root@dbserver ~]# cd /usr/local/src/
[root@dbserver src]# wget https://github.com/oliver006/redis_exporter/releases/download/v1.24.0/redis_exporter-v1.24.0.linux-amd64.tar.gz
[root@dbserver src]# mkdir -p /usr/local/prometheus/
[root@dbserver src]# tar xvf redis_exporter-v1.24.0.linux-amd64.tar.gz -C /usr/local/prometheus/
[root@dbserver src]# mv /usr/local/prometheus/redis_exporter-v1.24.0.linux-amd64/ /usr/local/prometheus/redis_exporter
5.2.将redis_exporter配置成系统服务
[root@dbserver src]# vi /etc/systemd/system/redis_exporter.service
[Unit]
Description=redis_exporter Server
Documentation=https://github.com/oliver006/redis_exporter
After=network.target

[Service]
ExecStart=/usr/local/prometheus/redis_exporter/redis_exporter \
  --web.listen-address=0.0.0.0:9121 \
  --redis.addr=127.0.0.1:6379 \
  --redis.password=Test#123
ExecStop=/bin/kill -SIGINT $MAINPID
Restart=on-failure
[Install]
WantedBy=multi-user.target
5.3.通过systemctl启动redis_exporter
[root@dbserver src]# systemctl daemon-reload
[root@dbserver src]# systemctl start redis_exporter
[root@dbserver src]# systemctl status redis_exporter
[root@dbserver src]# systemctl enable redis_exporter
5.4.验证redis_exporter
[root@dbserver src]# curl "http://127.0.0.1:9121/metrics"
5.5.防火墙配置
[root@dbserver src]# firewall-cmd --permanent --add-port=9121/tcp
[root@dbserver src]# firewall-cmd --reload

#也可以限定仅能指定的IP访问
[root@dbserver src]# firewall-cmd --permanent --add-rich-rule="rule family="ipv4" source address="192.168.1.100" port protocol="tcp" port="9121" accept"

#或可直接关闭防火墙
[root@dbserver src]# systemctl stop firewalld
[root@dbserver src]# systemctl disable firewalld

5.6.Prometheus侧配置
5.6.1.prometheus.yml配置调整
[root@dbserver src]# vi /usr/local/prometheus/prometheus/prometheus.yml
scrape_configs:
  # The job name is added as a label `job=<job_name>` to any timeseries scraped from this config.
  - job_name: 'prometheus'

    # metrics_path defaults to '/metrics'
    # scheme defaults to 'http'.

    static_configs:
    - targets: ['127.0.0.1:9090']

  - job_name: 'redis_exporter'
    static_configs:
    - targets: ['192.168.1.100:9121']
      labels:
        service: 服务A-Redis
    - targets: ['192.168.1.101:9121']
      labels:
        service: 服务B-Redis
5.6.2.校验配置正确性
[root@dbserver src]# /usr/local/prometheus/prometheus/promtool check config /usr/local/prometheus/prometheus/prometheus.yml 
5.6.3.重新加载配置
[root@dbserver src]# systemctl reload prometheus
5.6.4.验证结果
访问http://ip:9090/targets查看

5.6.5 Redis集群监控配置示例
(本人未验证)

  - job_name: 'redis_exporter_targets'
    static_configs:
      - targets:
        - redis://192.168.1.101:7000
        - redis://192.168.1.102:7001
        - redis://192.168.1.103:7002
        - redis://192.168.1.104:7003
        - redis://192.168.1.105:7004
        - redis://192.168.1.106:7005
    metrics_path: /scrape
    relabel_configs:
      - source_labels: [__address__]
        target_label: __param_target
      - source_labels: [__param_target]
        target_label: instance
      - target_label: __address__
        replacement: 192.168.1.100:9121
  ## config for scraping the exporter itself
  - job_name: 'redis_exporter'
    static_configs:
      - targets:
        - 192.168.1.100:9121
六、监控RabbitMQ
6.1.安装rabbitmq_prometheus
RabbitMQ 3.8版本以后已内置支持Prometheus插件
https://www.rabbitmq.com/prometheus.html

启用方式：

[root@dbserver src]# rabbitmq-plugins enable rabbitmq_prometheus
默认端口号为15692
启动后可访问 http://ip:15692/metrics

如要修改默认配置，对应配置文件为 /etc/rabbitmq/rabbitmq.conf
prometheus.path = /metrics
prometheus.tcp.port = 15692

也可以使用单独的rabbitmq_exporter来监控，可适应rabbitmq3.8以前版本
（注意 3.6.x与更早版本监控有差别，需要注意)
https://github.com/kbudde/rabbitmq_exporter/

6.2.验证rabbitmq_prometheus
[root@dbserver src]# curl "http://127.0.0.1:15692/metrics"
6.3.防火墙配置
[root@dbserver src]# firewall-cmd --permanent --add-port=15692/tcp
[root@dbserver src]# firewall-cmd --reload

#也可以限定仅能指定的IP访问
[root@dbserver src]# firewall-cmd --permanent --add-rich-rule="rule family="ipv4" source address="192.168.1.100" port protocol="tcp" port="15692" accept"

#或可直接关闭防火墙
[root@dbserver src]# systemctl stop firewalld
[root@dbserver src]# systemctl disable firewalld

6.4.Prometheus侧配置
6.4.1.prometheus.yml配置调整
[root@dbserver src]# vi /usr/local/prometheus/prometheus/prometheus.yml
scrape_configs:
  # The job name is added as a label `job=<job_name>` to any timeseries scraped from this config.
  - job_name: 'prometheus'

    # metrics_path defaults to '/metrics'
    # scheme defaults to 'http'.

    static_configs:
    - targets: ['127.0.0.1:9090']

  - job_name: 'rabbitmq_exporter'
    static_configs:
    - targets: ['192.168.1.100:15692']
      labels:
        service: 服务A-RabbitMQ
    - targets: ['192.168.1.101:15692']
      labels:
        service: 服务B-RabbitMQ
6.4.2.校验配置正确性
[root@dbserver src]# /usr/local/prometheus/prometheus/promtool check config /usr/local/prometheus/prometheus/prometheus.yml 
6.4.3.重新加载配置
[root@dbserver src]# systemctl reload prometheus
6.4.4.验证结果
访问http://ip:9090/targets查看

七、监控Elasticsearch
Elasticsearch Exporter
https://grafana.com/oss/prometheus/exporters/elasticsearch-exporter/
https://github.com/prometheus-community/elasticsearch_exporter

7.1.安装elasticsearch_exporter
[root@dbserver ~]# cd /usr/local/src
[root@dbserver src]# wget https://github.com/justwatchcom/elasticsearch_exporter/releases/download/v1.2.1/elasticsearch_exporter-1.2.1.linux-amd64.tar.gz
[root@dbserver src]# mkdir -p /usr/local/prometheus/
[root@dbserver src]# tar xvf elasticsearch_exporter-1.2.1.linux-amd64.tar.gz -C /usr/local/prometheus/
[root@dbserver src]# mv /usr/local/prometheus/elasticsearch_exporter-1.2.1.linux-amd64/ /usr/local/prometheus/elasticsearch_exporter
7.2.将elasticsearch_exporter配置成系统服务
[root@dbserver src]# vi /etc/systemd/system/elasticsearch_exporter.service
[Unit]
Description=elasticsearch_exporter Server
Documentation=https://github.com/prometheus-community/elasticsearch_exporter
After=network.target

[Service]
ExecStart=/usr/local/prometheus/elasticsearch_exporter/elasticsearch_exporter \
  --web.listen-address=0.0.0.0:9114 \
  --es.uri=http://127.0.0.1:9200
ExecStop=/bin/kill -SIGINT $MAINPID
Restart=on-failure
[Install]
WantedBy=multi-user.target
如果有启用账号密码，则需要携带上 http://admin:pass@localhost:9200

7.3.通过systemctl启动elasticsearch_exporter
[root@dbserver src]# systemctl daemon-reload
[root@dbserver src]# systemctl start elasticsearch_exporter
[root@dbserver src]# systemctl status elasticsearch_exporter
[root@dbserver src]# systemctl enable elasticsearch_exporter
7.4.验证elasticsearch_exporter
[root@dbserver src]# curl "http://127.0.0.1:9114/metrics"
7.5.防火墙配置
[root@dbserver src]# firewall-cmd --permanent --add-port=9114/tcp
[root@dbserver src]# firewall-cmd --reload

#也可以限定仅能指定的IP访问
[root@dbserver src]# firewall-cmd --permanent --add-rich-rule="rule family="ipv4" source address="192.168.1.100" port protocol="tcp" port="9114" accept"

#或可直接关闭防火墙
[root@dbserver src]# systemctl stop firewalld
[root@dbserver src]# systemctl disable firewalld
7.6.Prometheus侧配置
7.6.1.prometheus.yml配置调整
[root@dbserver src]# vi /usr/local/prometheus/prometheus/prometheus.yml
scrape_configs:
  # The job name is added as a label `job=<job_name>` to any timeseries scraped from this config.
  - job_name: 'prometheus'

    # metrics_path defaults to '/metrics'
    # scheme defaults to 'http'.

    static_configs:
    - targets: ['127.0.0.1:9090']

  - job_name: 'elasticsearch_exporter'
    static_configs:
    - targets: ['192.168.1.100:9114']
      labels:
        service: 服务A-Elasticsearch
    - targets: ['192.168.1.101:9114']
      labels:
        service: 服务B-Elasticsearch
7.6.2.校验配置正确性
[root@dbserver src]# /usr/local/prometheus/prometheus/promtool check config /usr/local/prometheus/prometheus/prometheus.yml 
7.6.3.重新加载配置
[root@dbserver src]# systemctl reload prometheus
7.6.4.验证结果
访问http://ip:9090/targets查看

八、监控Kafka
https://github.com/danielqsj/kafka_exporter/

8.1.安装kafka_exporter
[root@dbserver ~]# cd /usr/local/src/
[root@dbserver src]# wget https://github.com/danielqsj/kafka_exporter/releases/download/v1.3.1/kafka_exporter-1.3.1.linux-amd64.tar.gz
[root@dbserver src]# mkdir -p /usr/local/prometheus/
[root@dbserver src]# tar xvf kafka_exporter-1.3.1.linux-amd64.tar.gz -C /usr/local/prometheus/
[root@dbserver src]# mv /usr/local/prometheus/kafka_exporter-1.3.1.linux-amd64/ /usr/local/prometheus/kafka_exporter
8.2.将kafka_exporter配置成系统服务
[root@dbserver src]# vi /etc/systemd/system/kafka_exporter.service
[Unit]
Description=kafka_exporter Server
Documentation=https://github.com/danielqsj/kafka_exporter
After=network.target

[Service]
ExecStart=/usr/local/prometheus/kafka_exporter/kafka_exporter \
  --web.listen-address=0.0.0.0:9308 \
  --kafka.server=127.0.0.1:9092
ExecStop=/bin/kill -SIGINT $MAINPID
Restart=on-failure
[Install]
WantedBy=multi-user.target
8.3.通过systemctl启动kafka_exporter
[root@dbserver src]# systemctl daemon-reload
[root@dbserver src]# systemctl start kafka_exporter
[root@dbserver src]# systemctl status kafka_exporter
[root@dbserver src]# systemctl enable kafka_exporter
8.4.验证kafka_exporter
[root@dbserver src]# curl "http://127.0.0.1:9308/metrics"
8.5.防火墙配置
[root@dbserver src]# firewall-cmd --permanent --add-port=9308/tcp
[root@dbserver src]# firewall-cmd --reload

#也可以限定仅能指定的IP访问
[root@dbserver src]# firewall-cmd --permanent --add-rich-rule="rule family="ipv4" source address="192.168.1.100" port protocol="tcp" port="9308" accept"

#或可直接关闭防火墙
[root@dbserver src]# systemctl stop firewalld
[root@dbserver src]# systemctl disable firewalld

8.6.Prometheus侧配置
8.6.1.prometheus.yml配置调整
[root@dbserver src]# vi /usr/local/prometheus/prometheus/prometheus.yml
scrape_configs:
  # The job name is added as a label `job=<job_name>` to any timeseries scraped from this config.
  - job_name: 'prometheus'

    # metrics_path defaults to '/metrics'
    # scheme defaults to 'http'.

    static_configs:
    - targets: ['127.0.0.1:9090']

  - job_name: 'elasticsearch_exporter'
    static_configs:
    - targets: ['192.168.1.100:9308']
      labels:
        service: 服务A-Kafka
    - targets: ['192.168.1.101:9308']
      labels:
        service: 服务B-Kafka
8.6.2.校验配置正确性
[root@dbserver src]# /usr/local/prometheus/prometheus/promtool check config /usr/local/prometheus/prometheus/prometheus.yml 
8.6.3.重新加载配置
[root@dbserver src]# systemctl reload prometheus
8.6.4.验证结果
访问http://ip:9090/targets查看

九、监控Doris
Doris已内置支持对FE,BE的Promotheus监控支持
无需额外配置，防护墙允许Prometheus访问 8030,8040端口即可

9.1.验证doris_prometheus
#FE
[root@dbserver src]# curl "http://127.0.0.1:8030/metrics"

#BE
[root@dbserver src]# curl "http://127.0.0.1:8040/metrics"
9.2.Prometheus侧配置
9.2.1.prometheus.yml配置调整
[root@dbserver src]# vi /usr/local/prometheus/prometheus/prometheus.yml
scrape_configs:
  # The job name is added as a label `job=<job_name>` to any timeseries scraped from this config.
  - job_name: 'prometheus'

    # metrics_path defaults to '/metrics'
    # scheme defaults to 'http'.

    static_configs:
    - targets: ['127.0.0.1:9090']

  - job_name: 'doris_cluster'
    static_configs:
    - targets: ['192.168.1.100:8030','192.168.1.101:8030']
      labels:
	    service: 服务A-Doris-FE
        group: fe

    - targets: ['192.168.1.102:8040','192.168.1.103:8040','192.168.1.104:8040']
      labels:
	    service: 服务A-Doris-BE
        group: be

9.2.2.校验配置正确性
[root@dbserver src]# /usr/local/prometheus/prometheus/promtool check config /usr/local/prometheus/prometheus/prometheus.yml 
9.2.3.重新加载配置
[root@dbserver src]# systemctl reload prometheus
9.2.4.验证结果
访问http://ip:9090/targets查看

十、监控端口(HTTP/TCP等)
10.1.安装blackbox_exporter
这里使用 blackbox_exporter来监控HTTP/TCP

[root@appserver ~]# cd /usr/local/src/
[root@appserver src]# wget https://github.com/prometheus/blackbox_exporter/releases/download/v0.19.0/blackbox_exporter-0.19.0.linux-amd64.tar.gz
[root@appserver src]# tar xvf blackbox_exporter-0.19.0.linux-amd64.tar.gz -C /usr/local/prometheus/
[root@appserver src]# mv /usr/local/prometheus/blackbox_exporter-0.19.0.linux-amd64/ /usr/local/prometheus/blackbox_exporter
10.2.将blackbox_exporter配置成系统服务
编辑启动文件

[root@appserver src]# vi /etc/systemd/system/blackbox_exporter.service
[Unit]
Description=blackbox_exporter Server
Documentation=https://prometheus.io/docs/introduction/overview/
After=network.target
  
[Service]
Restart=on-failure
WorkingDirectory=/usr/local/prometheus/blackbox_exporter
ExecStart=/usr/local/prometheus/blackbox_exporter/blackbox_exporter \
  --web.listen-address ":9115" \
  --config.file=/usr/local/prometheus/blackbox_exporter/blackbox.yml
ExecReload=/bin/kill -s HUP $MAINPID
ExecStop=/bin/kill -SIGINT $MAINPID

[Install]
WantedBy=multi-user.target
10.3.通过systemctl启动blackbox_exporter
[root@appserver src]# systemctl daemon-reload
[root@appserver src]# systemctl start blackbox_exporter
[root@appserver src]# systemctl status blackbox_exporter
[root@appserver src]# systemctl enable blackbox_exporter
10.4.Prometheus侧配置
10.4.1.prometheus.yml配置调整
[root@dbserver src]# vi /usr/local/prometheus/prometheus/prometheus.yml
scrape_configs:
  # The job name is added as a label `job=<job_name>` to any timeseries scraped from this config.
  - job_name: 'prometheus'

    # metrics_path defaults to '/metrics'
    # scheme defaults to 'http'.

    static_configs:
    - targets: ['127.0.0.1:9090']

# 网站监控
  - job_name: 'http_status'
    metrics_path: /probe
    params:
      module: [http_2xx]
    static_configs:
      - targets: ['http://a1.domain.com:81']
        labels:
          env: PROD
          domain: "a1.domain.com"
          port: "81"
          service: 服务A
          instance: "http://a1.domain.com:81"
          group: web
      - targets: ['http://a1.domain.com:82/abc']
        labels:
          env: PROD
          domain: "a1.domain.com"
          port: "82"
          service: XX API接口
          instance: "http://a1.domain.com:82/abc"
          group: api

    relabel_configs:
      - source_labels: [__address__]
        target_label: __param_target
      - target_label: __address__
        replacement: 192.168.1.100:9115 
		
# ping 检测
  - job_name: 'ping_status'
    metrics_path: /probe
    params:
      module: [icmp]
    static_configs:
      - targets: ['192.168.1.100']
        labels:
          env: PROD
          service: 服务B IP
          instance: "192.168.1.100"
          group: ping

    relabel_configs:
      - source_labels: [__address__]
        target_label: __param_target
      - target_label: __address__
        replacement: 192.168.1.100:9115 
		
# 端口监控
  - job_name: 'port_status'
    metrics_path: /probe
    params:
      module: [tcp_connect]
    static_configs:
      - targets: ['192.168.1.100:84']
        labels:
          env: PROD
          port: "84"
          service: 服务B XX端口
          instance: "192.168.1.100:84"
          group: port

    relabel_configs:
      - source_labels: [__address__]
        target_label: __param_target
      - target_label: __address__
        replacement: 192.168.1.100:9115 
blackbox_exporter涉及的module配置文件 /usr/local/prometheus/blackbox_exporter/blackbox.yml

网上示例参考：https://github.com/tools-env/blackbox_exporter/blob/master/example.yml

10.4.2.校验配置正确性
[root@dbserver src]# /usr/local/prometheus/prometheus/promtool check config /usr/local/prometheus/prometheus/prometheus.yml 
10.4.3.重新加载配置
[root@dbserver src]# systemctl reload prometheus
10.4.4.验证结果
访问http://ip:9090/targets查看

十一、监控MongoDB
https://github.com/percona/mongodb_exporter

11.1.安装mongodb_exporter
[root@dbserver ~]# cd /usr/local/src/
[root@dbserver src]# wget https://github.com/percona/mongodb_exporter/releases/download/v0.20.7/mongodb_exporter-0.20.7.linux-amd64.tar.gz
[root@dbserver src]# mkdir -p /usr/local/prometheus/
[root@dbserver src]# tar xvf mongodb_exporter-0.20.7.linux-amd64.tar.gz -C /usr/local/prometheus/
[root@dbserver src]# mv /usr/local/prometheus/mongodb_exporter-0.20.7.linux-amd64 /usr/local/prometheus/mongodb_exporter

11.2.将mongodb_exporter配置成系统服务
[root@dbserver src]# vi /etc/systemd/system/mongodb_exporter.service
[Unit]
Description=mongodb_exporter Server
Documentation=https://github.com/percona/mongodb_exporter
After=network.target

[Service]
ExecStart=/usr/local/prometheus/mongodb_exporter/mongodb_exporter \
  --web.listen-address=0.0.0.0:9216 \
  --mongodb.uri=mongodb://username:password@127.0.0.1:27017/admin?replicaSet=rs0&&authSource=admin
ExecStop=/bin/kill -SIGINT $MAINPID
Restart=on-failure
[Install]
WantedBy=multi-user.target
11.3.通过systemctl启动mongodb_exporter
[root@dbserver src]# systemctl daemon-reload
[root@dbserver src]# systemctl start mongodb_exporter
[root@dbserver src]# systemctl status mongodb_exporter
[root@dbserver src]# systemctl enable mongodb_exporter
11.4.验证mongodb_exporter
[root@dbserver src]# curl "http://127.0.0.1:9216/metrics"
11.5.防火墙配置
[root@dbserver src]# firewall-cmd --permanent --add-port=9216/tcp
[root@dbserver src]# firewall-cmd --reload

#也可以限定仅能指定的IP访问
[root@dbserver src]# firewall-cmd --permanent --add-rich-rule="rule family="ipv4" source address="192.168.1.100" port protocol="tcp" port="9216" accept"

#或可直接关闭防火墙
[root@dbserver src]# systemctl stop firewalld
[root@dbserver src]# systemctl disable firewalld

11.6.Prometheus侧配置
11.6.1.prometheus.yml配置调整
[root@dbserver src]# vi /usr/local/prometheus/prometheus/prometheus.yml
scrape_configs:
  # The job name is added as a label `job=<job_name>` to any timeseries scraped from this config.
  - job_name: 'prometheus'

    # metrics_path defaults to '/metrics'
    # scheme defaults to 'http'.

    static_configs:
    - targets: ['127.0.0.1:9090']

  - job_name: 'mongodb_exporter'
    static_configs:
    - targets: ['192.168.1.100:9216']
      labels:
        service: 服务A-MongoDB
附:其他参考资料
https://www.cnblogs.com/cyleon/category/1756369.html
https://www.cnblogs.com/gaofeng-henu/category/1675861.html
https://www.cnblogs.com/winstom/p/11926140.html
https://www.cnblogs.com/caoweixiong/category/1622389.html
https://www.bookstack.cn/read/prometheus-book/README.md
weixing_2006
关注
  • 0
    点赞
  • 踩
  • 3
    收藏
    觉得还不错? 一键收藏
  • 1
    评论
专栏目录
【Doris】Prometheus+Grafana监控Doris
m0_54252387的博客
07-19 3676
DorisDB提供两种监控报警的方案，第一种是使用内置的DorisManager，其自带的Agent从各个Host采集监控信息上报到Center Service然后做可视化展示，也提供了邮件和Webhook的方式发送报警通知。但是如果用户为了二次开发需求，需要自己搭建部署监控服务，也可以使用开源的Prometheus+Grafana的方案，DorisDB提供了兼容Prometheus的信息采集接口，可以通过直接链接BE/FE的HTTP端口来获取集群的监控信息。如果采购DorisDB企业版，则提供DorisM
prometheus+grafana监控rabbitmq
weixin_41048370的博客
03-04 1084
prometheus+grafana监控rabbitmq1. 安装rabbitmq2. 安装kbudde/rabbitmq-exporter3. prometheus监控配置4. grafana界面设置 参考文档：docker hub中介绍 1. 安装rabbitmq 注意 拉取rabbitmq镜像时需要managment的tag，否则不带界面 run的时候设置环境变量，映射9419端口 docker pull rabbitmq:management docker run -d -e RABBITMQ_
Prometheus各类中间件的监控接入
qq_41896822的博客
06-25 1130
prometheus监控生态中，各类中间件的部署
五分钟带你玩转prometheus（五）监控rabbitmq
小鲍侃java
09-10 1642
一.下载 rabbitmq_exporter 链接：https://pan.baidu.com/s/1It9m5qA-IRzps_pX0Y9PpQ 提取码：9m28 rabbitmq-monitoring_rev4（模板） 链接：https://pan.baidu.com/s/19ZuCfJNyAd0kDzRva-9R1g 提取码：pmvx 二.安装rabbitmq_exporter 解压 tar -zxvf rabbitmq_exporter-1.0.0-RC7.linux-am...
Prometheus监控
fangandpu的博客
02-08 1737
目录 一、Prometheus简介 1.1 Prometheus概述 二、Prometheus特点 三、Prometheus监控体系 1.系统层监控(需要监控的数据) 2.间件及基础设施类监控 3.应用层监控 4.业务层监控 一、Prometheus简介 1.1 Prometheus概述 Prometheus是...
使用Prometheus和Grafana监控Apache Doris
Bulut0907
12-26 2269
Doris的FE和BE通过http端口metrics路径，将监控数据暴露出来，以key-value的文本形式对外展现，每个key还可能有不同的Label加以区分。Prometheus再从Doris拉取监控数据。
基于Prometheus+Grafana搭建JMeter性能测试监控平台.docx
08-04
基于Prometheus+Grafana搭建JMeter性能测试监控平台.docx 做性能测试，如果没有养成良好的保存结果习惯，那么一个业务指标监控平台就必不可少，不仅可以在线监控，还可以用于报告总结，数据持久化的好处就是让人眼前...
Prometheus+Grafana 监控平台实践-搭建&常用服务监控&告警
最新发布
我不懂，可我不傻
07-31 1287
Prometheus 是一个开放性的监控解决方案，通过各种 Exporter 采集当前主机/服务的数据，和 Grafana 相结合可以实现强大的监控和可视化功能本篇将分享使用 docker compose 构建 Prometheus+Grafana，并监控之前文章所搭建的主机&服务，分享日常使用的一些使用经验文章较长，已安装可略过，推荐先看第三节常用服务的 Prometheus+Grafana 配置。
Centos7下搭建Prometheus+Grafana并部署基础监控
2301_78479213的博客
04-02 1840
Centos7下搭建Prometheus+Grafana并部署基础监控
搭建Prometheus+Grafana的云平台监控系统
xueshenlaila的博客
06-16 7030
1.1 Prometheus和Grafana概述 1.1.1 Prometheus概述 Prometheus（普罗米修斯）是一套开源的监控&报警&时间序列数据库的组合，起始是由SoundCloud公司开发的。现在最常见的Docker、Mesos、Kubernetes容器管理系统中，通常会搭配Prometheus进行监控。 Prometheus [prəˈmiθju:s] 普罗米修斯 Prometheus基本原理是通过HTTP协议周期性抓取被监控组件的状态，这样做的好处是任意组件只要提供.
K8s（十二）：监控与报警（163邮箱+钉钉）-Prometheus + Grafana + Alertmanager（超详细）
热门推荐
✨ 欢迎来到【Seal ^_^ 的CSDN博客】！这里是我记录技术心得、分享经验的地方。✨
04-08 1万+
🔴 K8s（十二）：监控与报警（163邮箱+钉钉）-Prometheus + Grafana + Alertmanager（超详细）
基于Prometheus+Grafana搭建监控平台-（3）实现监控ElasticSearch
老杜的博客
09-23 1564
基于Prometheus+Grafana搭建监控平台-实现监控ElasticSearch
基于prometheus与grafana对starrocks/doris监控报警
qq_43118086的博客
07-20 1342
基于prometheus与grafana监控starrocks/doris实现自定义指标监控与报警
prometheus怎么监控服务器硬件设备
weixin_35749440的博客
02-11 736
Prometheus是一个开源的系统监控和告警工具，默认不能直接监控服务器硬件设备。但是可以通过第三方的插件(如node_exporter)来实现硬件设备的监控。 安装node_exporter，然后启动它，它将暴露一些指标，比如系统内存，CPU，磁盘使用情况等，可以在Prometheus的配置文件中配置对node_exporter的监控。 最后，可以在Prometheus的图形界面中查看硬件设备...
运用prometheus+grafana 搭建监控体系(二)
weixin_43871079的博客
05-10 339
上一篇主要说了如何安装，本篇主要对监控配置文件进行说明。
Doris学习笔记之监控
四国棋客
07-30 1393
Doris可以使用Prometheus和Grafana进行监控和采集，官网下载最新版即可。Doris的监控数据通过FE和BE的http接口向外暴露。监控数据以key-value的文本形式对外展现。每个key还可能有不同的Label加以区分。
转载，通过 Prometheus Alertmanager 模块发送 Doris 异常信息至钉钉报警群
qq_31866793的博客
02-18 647
基础环境 1.Prometheus 版本：2.22.2 下载地址： https://github.com/prometheus/prometheus/releases/download/v2.22.2/prometheus-2.22.2.linux-amd64.tar.gz 2.Alertmanager 版本：0.23 下载地址： https://github.com/prometheus/alertmanager/releases/download/v0.23.0/alertmanager-0..
搭建 Jmx_exporter + Prometheus + Grafana 监控kafka
w363403269的专栏
07-01 1567
一、 启动jmx_exporter 1. 下载并打包(mvn package)jmx_exporter https://github.com/prometheus/jmx_exporter 测试jar包(kafka的jmx端口为9898): java -cp collector/target/collector-0.15.1-SNAPSHOT.jar io.prometheus.jmx.JmxScraper service:jmx:rmi:///jndi/rmi://localhost:9898/jm
prometheus+grafana监控kafka
Bill_Xiang的专栏
07-11 5081
前段时间简单研究了一下prometheus+grafana监控kafka，现在教别人线上部署，把聊天记录发一下，当是给自己记录一下 一根筋10:37:48 压缩包里装这两个一根筋10:38:55 prometheus的目录得配到kafka里面 ， 还有那个jar包 每个kafka机器这个文件都得配上，机器对应目录也都有相应文件 一根筋10:50:14 kafka这...
使用 Prometheus + Grafana 搭建可视化的 Gitea 服务器监控面板
05-24
好的，以下是搭建步骤： 1. 首先安装和配置 Prometheus 和 Grafana。可以参考官方文档进行安装和配置。 2. 在 Prometheus 的配置文件（`prometheus.yml`）中添加 Gitea 的监控配置： ``` scrape_configs: - job_name: 'gitea' metrics_path: /metrics static_configs: - targets: ['localhost:3000'] ``` 这里的 `targets` 指的是 Gitea 服务器的地址和端口号。 3. 启动 Prometheus 服务，并确认 Gitea 监控已经被添加到 Prometheus 中。 4. 在 Grafana 中创建一个新的 Dashboard，并添加一个新的 Panel。选择 `Prometheus` 数据源，并在查询中输入类似于以下内容的 PromQL 查询： ``` rate(http_request_duration_seconds_count{job="gitea", handler="*"}[5m]) ``` 这个查询将返回 Gitea 服务器的 HTTP 请求响应时间。 5. 配置 Panel，选择想要显示的图表类型、时间范围和其他选项。 6. 保存 Dashboard，现在就可以在 Grafana 中看到 Gitea 的监控数据了。 希望这个步骤可以帮助你搭建一个可视化的 Gitea 服务器监控面板。
评论 1
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值