CEPH的学习笔记(八) 安装监视器Prometheus报警系统AlertManager

杨康小学僧

已于 2024-04-01 09:52:24 修改

阅读量383

点赞数

文章标签：监视器 Prometheus 报警系统 AlertManager

于 2019-03-20 14:33:12 首次发布

本文链接：https://blog.csdn.net/yangkang1122/article/details/88688319

版权

CEPH的学习笔记(七) 安装监视器Prometheus报警系统AlertManager

下载AlertManager对应的安装包并解压：

Wget https://github.com/prometheus/alertmanager/releases/download/v0.15.2/alertmanager-0.15.2.linux-amd64.tar.gz
tar zxvf alertmanager-0.15.2.linux-amd64.tar.gz

进入AlertManager的文件夹并将指定文件复制到指定目录中去：

 cd alertmanager-0.15.2.linux-amd64
cp alertmanager amtool /usr/bin/
cp alertmanager.yml /etc/prometheus/

配置 systemd 的 unit 文件：

vi /lib/systemd/system/alertmanager.service
        [Unit]
          Description=Prometheus: the alerting system
          Documentation=http://prometheus.io/docs/
          After=prometheus.service
        [Service]
          ExecStart=/usr/bin/alertmanager --config.file=/etc/prometheus/alertmanager.yml
          Restart=always
          StartLimitInterval=0
          RestartSec=10
        [Install]
          WantedBy=multi-user.target

启动AlertManager服务，并配置开机启动：

 systemctl enable alertmanager.service
 systemctl start alertmanager.service

在Prometheus 的配置文件中添加 AlertManager 的信息，并重启 Prometheus的服务：

 vi /etc/prometheus/prometheus.yml
           alerting:
              alertmanagers:
               - static_configs:
                 - targets: ["localhost:9093"]
           systemctl restart prometheus.service

注册登录企业版钉钉，在群里添加机器人，获取webhook：
获取prometheus-webhook，并以容器运行：

docker pull timonwong/prometheus-webhook-dingtalk:v0.3.0
docker run -d --restart always -p 8060:8060 timonwong/prometheus-webhook-dingtalk:v0.3.0 --ding.profile="webhook1= https://oapi.dingtalk.com/robot/send?access_token=f0a0b993e82d1f2640a28951c729305ec8ff72de80a75e719f21b4c8bbe18f19"

配置 AlertManager 告警规则：

vi /etc/prometheus/alertmanager.yml
          global:
              resolve_timeout: 5m
          route:
              group_by: ['alertname']
              group_wait: 10s
              group_interval: 10s
              repeat_interval: 1h
              receiver: 'web.hook'
          receivers:
              - name: 'web.hook'
                 webhook_configs:
                  - url: 'http://localhost:8060/dingtalk/web.hook/send'
          inhibit_rules:
              - source_match:
                severity: 'critical'
              target_match:
                severity: 'warning'
              equal: ['alertname', 'dev', 'instance']

修改 /etc/prometheus/prometheus.yml，添加告警规则文件：

vi /etc/prometheus/prometheus.yml
              ......
            rule_files:
                - /etc/prometheus/rules/ceph.yaml

修改/etc/prometheus/rules/ceph.yaml，发送告警消息：

groups:
- name: ceph-rule
           rules:
           - alert: CephCapacityUsage
            expr: ceph_cluster_available_bytes / ceph_cluster_capacity_bytes * 100 > 85 
            for: 2m
            labels:
               product: ceph
             annotations:
               summary: "{{$labels.instance}}: Not enough capacity in Ceph detected"
               description: "{{$labels.instance}}: Available capacity is used up to 70% (current value is: {{ $value }}"

重启 AlertManager 和 Prometheus 服务：

systemctl restart alertmanager.service
systemctl restart prometheus.service