Redis监控：Grafana + Prometheus + redis_exporter & Grafana + Redis 监控 Redis

已于 2024-04-11 17:37:25 修改
阅读量1.4k 收藏 29
点赞数 45
文章标签： redis 数据库 缓存 prometheus grafana linux centos
于 2024-02-02 11:39:05 首次发布
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/a1808862593/article/details/135990072
版权

// 文档指南
文档使用 Prometheus数据源 和 Redis数据源 两种数据源选择来监控Redis，主要以Prometheus数据源为主

监控的组成部分：

  • 使用Prometheus数据源可以分为三部分
    1. redis_exporter 连接redis暴露redis指标
    2. prometheus 抓取redis_exporte暴露的redis指标
    3. grafana 使用prometheus抓取到的数据作为数据源，通过配置仪表盘进行分析
  • 使用Redis数据源就简单许多了，只用一步
    1. 直接使用 grafana 选择redis数据源连接redis，这样就可以直接添加仪表盘进行分析

文档中的的准备工作（redis主从 和 redis集群）主要是为了方便演示配置，实际尝试部署的时候准备简单的主从架构就可以
感觉麻烦 或者 想快速部署先看看效果 也可以使用我的部署脚本

★ 准备工作

  • 准备 redis 主从（哨兵）
IPportrole
50.50.50.1006379master
50.50.50.1006380slave
50.50.50.1006381slave
  • 准备 redis 集群
IPportrole
50.50.50.1007000master
50.50.50.1007001master
50.50.50.1007002master
50.50.50.1007003slave
50.50.50.1007004slave
50.50.50.1007005slave
  • 为了方便我这里是部署的是单机多实例

▶ Grafana + Prometheus 数据源 监控 Redis

https://prometheus.io/download/

一、部署配置 Prometheus + Redis、Node 的 exporter 插件

  • 部署 prometheus 作为监控系统的核心组件，负责收集、存储和查询来自 redis_exporter node_exporter 的指标数据，并提供给Grafana进行可视化展示
  • 安装 redis_exporter、node_exporter 插件
  • 配置 prometheus 连接 redis_exporter、node_exporter
  • 访问 prometheus web 界面查看

1.1 部署配置 Prometheus

1.1.1 准备二进制安装包
https://github.com/prometheus/prometheus

prometheus-2.45.2.linux-amd64.tar.gz
1.1.2 安装
tar -zxf prometheus-2.45.2.linux-amd64.tar.gz

mkdir /usr/local/prometheus

mv prometheus-2.45.2.linux-amd64 /usr/local/prometheus/prometheus-2.45.2
1.1.3 配置
cd /usr/local/prometheus/prometheus-2.45.2

vim prometheus.yml

# my global config
global:
  scrape_interval: 15s # Set the scrape interval to every 15 seconds. Default is every 1 minute.
  evaluation_interval: 15s # Evaluate rules every 15 seconds. The default is every 1 minute.
  # scrape_timeout is set to the global default (10s).

# Alertmanager configuration
alerting:
  alertmanagers:
    - static_configs:
        - targets:
          # - alertmanager:9093

# Load rules once and periodically evaluate them according to the global 'evaluation_interval'.
rule_files:
  # - "first_rules.yml"
  # - "second_rules.yml"

# A scrape configuration containing exactly one endpoint to scrape:
# Here it's Prometheus itself.
scrape_configs:
  # The job name is added as a label `job=<job_name>` to any timeseries scraped from this config.
  - job_name: "A_prometheus_9099"

    # metrics_path defaults to '/metrics'
    # scheme defaults to 'http'.
    #
    static_configs:
      - targets: ["50.50.50.100:9099"]
1.1.4 启动
vim /usr/lib/systemd/system/prometheus.service

[Unit]
Description=https://prometheus.io
[Service]
Restart=on-failure
ExecStart=/usr/local/prometheus/prometheus-2.45.2/prometheus \
 --storage.tsdb.path=/usr/local/prometheus/prometheus-2.45.2/data \
 --config.file=/usr/local/prometheus/prometheus-2.45.2/prometheus.yml \
 --web.listen-address=:9099
[Install]
WantedBy=multi-user.target

systemctl start prometheus.service

systemctl enable prometheus.service

1.2 部署配置 node_exporter 模块

  • node_exporter 是 Prometheus 的一个插件，用于收集和暴露系统级别的监控指标
  • 它可以在被监控的主机上运行，并通过HTTP接口提供各种系统指标，如CPU使用率、内存使用率、磁盘空间、网络流量等。这些指标可以被 Prometheus 服务器收集和存储，然后用于监控和报警
  • 通过安装和配置 node_exporter 插件，Prometheus 可以实时监控被监控主机的各种系统指标，并将其存储在时间序列数据库中
  • 这样，用户可以使用 Prometheus 的查询语言（PromQL）来查询和分析这些指标，并根据需要创建自定义的监控规则和报警
1.2.1 准备二进制安装包
https://github.com/prometheus/node_exporter

node_exporter-1.7.0.linux-amd64.tar.gz
1.2.2 安装
tar -zxf node_exporter-1.7.0.linux-amd64.tar.gz

mv node_exporter-1.7.0.linux-amd64 /usr/local/prometheus/node_exporter-1.7.0
1.2.3 启动
[Unit]
Description=Prometheus node_exporter
[Service]
User=root
ExecStart=/usr/local/prometheus/node_exporter-1.7.0/node_exporter
ExecStop=/usr/bin/killall node_exporter
[Install]
WantedBy=default.target

systemctl start prometheus.service

systemctl enable redis_exporter.service
1.2.4 配置 prometheus 连接 node_exporter
vim /usr/local/prometheus/prometheus-2.45.2/prometheus.yml

# my global config
global:
  scrape_interval: 15s # Set the scrape interval to every 15 seconds. Default is every 1 minute.
  evaluation_interval: 15s # Evaluate rules every 15 seconds. The default is every 1 minute.
  # scrape_timeout is set to the global default (10s).

# Alertmanager configuration
alerting:
  alertmanagers:
    - static_configs:
        - targets:
          # - alertmanager:9093

# Load rules once and periodically evaluate them according to the global 'evaluation_interval'.
rule_files:
  # - "first_rules.yml"
  # - "second_rules.yml"

# A scrape configuration containing exactly one endpoint to scrape:
# Here it's Prometheus itself.
scrape_configs:
  # The job name is added as a label `job=<job_name>` to any timeseries scraped from this config.
  - job_name: "A_prometheus_9099"

    # metrics_path defaults to '/metrics'
    # scheme defaults to 'http'.
    #
    static_configs:
      - targets: ["50.50.50.100:9099"]

  - job_name: "A_exporter_node_9100"
    static_configs:
      - targets: ['50.50.50.100:9100']
1.2.5 重启 prometheus
systemctl restart prometheus.service

1.3 部署配置 redis_exporter 模块

  • redis_exporter 中的作用是用于监控和收集 Redis 数据库的性能指标
  • 它是一个用于 Prometheus 的 Redis 监控导出器，可以通过暴露 Redis 服务器的指标来实时监控 Redis 数据库的运行状态
  • redis_exporter 会定期从 Redis 服务器获取指标数据，并将其提供给 Prometheus 进行存储和分析
  • 通过将 redis_exporter 与 Prometheus 集成，您可以实时监控 Redis 的运行状况，并使用 Prometheus 的强大查询和可视化功能来分析和展示这些指标数据
1.3.1 准备二进制安装包
https://github.com/oliver006/redis_exporter

redis_exporter-v1.47.0.linux-amd64.tar.gz //稳定版本
1.3.2 安装
tar -zxf redis_exporter-v1.56.0.linux-amd64.tar.gz

mv redis_exporter-v1.47.0.linux-amd64.tar.gz /usr/local/prometheus/redis_exporter-1.47.0
1.3.3 配置认证文件
cd /usr/local/prometheus/redis_exporter-1.47.0

mkdir password_file
1.3.3.1 redis集群 认证
vim redis-cluster-password.json

{
  "redis://50.50.50.100:7000": "redis-password-1",
  "redis://50.50.50.100:7001": "redis-password-1",
  "redis://50.50.50.100:7002": "redis-password-1",
  "redis://50.50.50.100:7003": "redis-password-1",
  "redis://50.50.50.100:7004": "redis-password-1",
  "redis://50.50.50.100:7005": "redis-password-1"
}
1.3.3.2 redis主从 认证
vim redis-sentinel-password.json

{
  "redis://50.50.50.100:6379": "redis-password-2",
  "redis://50.50.50.100:6380": "redis-password-2",
  "redis://50.50.50.100:6381": "redis-password-2"
}
1.3.4 编写启动脚本
cd /usr/local/prometheus/redis_exporter-1.47.0

mkdir script && mkdir logs

cd /usr/local/prometheus/redis_exporter-1.47.0/script
1.3.4.1 redis集群 检出启动脚本
vim redis-cluster-9121.sh

#!/bin/bash

INSTALL_PATH=/usr/local/prometheus/redis_exporter-v1.47.0
PASSWORD_FILE=$INSTALL_PATH/password_file/redis-cluster-password.json
REDIS_ADDR=50.50.50.100:7000
PORT=9121

nohup $INSTALL_PATH/redis_exporter \
 -redis.addr $REDIS_ADDR \
 -redis.password-file $PASSWORD_FILE \
 -web.listen-address :$PORT \
 > $INSTALL_PATH/logs/redis-cluster-9121 &
1.3.4.1 redis主从 检出启动脚本
vim redis-sentinel-9122.sh

#!/bin/bash

INSTALL_PATH=/usr/local/prometheus/redis_exporter-v1.47.0
PASSWORD_FILE=$INSTALL_PATH/password_file/redis-sentinel-password.json
REDIS_ADDR=50.50.50.100:6379
PORT=9122

nohup $INSTALL_PATH/redis_exporter \
 -redis.addr $REDIS_ADDR \
 -redis.password-file $PASSWORD_FILE \
 -web.listen-address :$PORT \
 > $INSTALL_PATH/logs/redis-sentinel-9122 &
1.3.5 启动
sh redis-cluster-9121.sh

sh redis-sentinel-9122.sh

echo '/bin/sh /usr/local/prometheus/redis_exporter-1.47.0/script/redis-cluster-9121.sh' >> /etc/rc.d/rc.local
echo '/bin/sh /usr/local/prometheus/redis_exporter-1.47.0/script/redis-sentinel-9122.sh' >> /etc/rc.d/rc.local

chmod +x /etc/rc.d/rc.local
  • 以下是进行调试时使用的参数 -debug 和 指定 redis 集群模式的参数 -is-cluster=true
  • 由于选择集群 -is-cluster=true 在使用 -redis.password-file 时无法读取密码文件（至少我在测试的时候没有读取到密码，也不知道是集群的密码配置会有区别还是 bug），所以上面的集群模式我没有使用 -is-cluster=true 参数
  • 如果想使用 -is-cluster=true 参数导出，那么可以使用 -redis.password 来指定密码（不过这样会有一个问题，密码明文会暴露在进程中）
# ./redis_exporter -redis.addr 50.50.50.100:6379 -redis.password-file sample-pwd-file.json -debug
# ./redis_exporter -redis.addr 50.50.50.100:7000 -redis.password redis-password -is-cluster=true -debug
1.3.6 查看日志
  • 如果出现以下日志输出为正常，应该是 redis_exporter 这条日志输出级别设置错了
  • 提示你配置加载自哪里，level 应该是 info 而不是 error，忽略就可以
time="2024-01-29T17:08:06+08:00" level=error msg="Loaded 3 entries from
1.3.4 配置 prometheus 连接 redis_exporter
  • 配置 prometheus 连接 redis_exporter 端口用于检测存活
vim /usr/local/prometheus/prometheus-2.45.2/prometheus.yml

# my global config
global:
  scrape_interval: 15s # Set the scrape interval to every 15 seconds. Default is every 1 minute.
  evaluation_interval: 15s # Evaluate rules every 15 seconds. The default is every 1 minute.
  # scrape_timeout is set to the global default (10s).

# Alertmanager configuration
alerting:
  alertmanagers:
    - static_configs:
        - targets:
          # - alertmanager:9093

# Load rules once and periodically evaluate them according to the global 'evaluation_interval'.
rule_files:
  # - "first_rules.yml"
  # - "second_rules.yml"

# A scrape configuration containing exactly one endpoint to scrape:
# Here it's Prometheus itself.
scrape_configs:
  # The job name is added as a label `job=<job_name>` to any timeseries scraped from this config.
  - job_name: "A_prometheus_9099"

    # metrics_path defaults to '/metrics'
    # scheme defaults to 'http'.
    #
    static_configs:
      - targets: ["50.50.50.100:9099"]

  - job_name: "A_exporter_node_9100"
    static_configs:
      - targets: ['50.50.50.100:9100']

  - job_name: "A_exporter_redis_9121"
    static_configs:
      - targets: ['50.50.50.100:9121']

  - job_name: "A_exporter_redis_9122"
    static_configs:
      - targets: ['50.50.50.100:9122']
1.3.5 重启 prometheus
systemctl restart prometheus.service

1.4 浏览器访问 Prometheus

  • 浏览器访问 prometheus 50.50.50.100:9099
  • 查看 prometheus、node_exporter、redis_exporter 是否存活 
http://50.50.50.100:9099/

在这里插入图片描述

在这里插入图片描述

二、Prometheus 配置抓取多个 Redis 主机

2.1 配置 Prometheus 连接 redis_exporter

  • 配置 prometheus 连接 redis_exporter 端口，用于抓取多个 Redis 主机
cd /usr/local/prometheus/prometheus-2.45.2

vim prometheus.yml

# my global config
global:
  scrape_interval: 15s # Set the scrape interval to every 15 seconds. Default is every 1 minute.
  evaluation_interval: 15s # Evaluate rules every 15 seconds. The default is every 1 minute.
  # scrape_timeout is set to the global default (10s).

# Alertmanager configuration
alerting:
  alertmanagers:
    - static_configs:
        - targets:
          # - alertmanager:9093

# Load rules once and periodically evaluate them according to the global 'evaluation_interval'.
rule_files:
  # - "first_rules.yml"
  # - "second_rules.yml"

# A scrape configuration containing exactly one endpoint to scrape:
# Here it's Prometheus itself.
scrape_configs:
  # The job name is added as a label `job=<job_name>` to any timeseries scraped from this config.
  - job_name: 'A_prometheus_9099'

    # metrics_path defaults to '/metrics'
    # scheme defaults to 'http'.
    #
    static_configs:
      - targets: ["50.50.50.100:9099"]

  - job_name: 'A_exporter_node_9100'
    static_configs:
      - targets: ['50.50.50.100:9100']

# redis exporter prot
  - job_name: 'A_exporter_redis_9121'
    static_configs:
      - targets: ['50.50.50.100:9121']

  - job_name: 'A_exporter_redis_9122'
    static_configs:
      - targets: ['50.50.50.100:9122']

# redis exporter
  - job_name: 'text_A_redis_cluaster'
    file_sd_configs:
      - files:
        - redis_exporter_conf/text_A_redis_cluaster.json
    metrics_path: /scrape
    relabel_configs:
      - source_labels: [__address__]
        target_label: __param_target
      - source_labels: [__param_target]
        target_label: instance
      - target_label: __address__
        replacement: 50.50.50.100:9121


  - job_name: 'text_B_redis_sentinel'
    file_sd_configs:
      - files:
        - redis_exporter_conf/text_B_redis_sentinel.json
    metrics_path: /scrape
    relabel_configs:
      - source_labels: [__address__]
        target_label: __param_target
      - source_labels: [__param_target]
        target_label: instance
      - target_label: __address__
        replacement: 50.50.50.100:9122

2.2 重启服务 Prometheus

systemctl restart prometheus

2.3 配置抓取 Redis 热加载文件

  • 配置 prometheus 热加载文件，用于抓取 redis_exporter 导出的redis指标
cd /usr/local/prometheus/prometheus-2.45.2 && mkdir redis_exporter_conf

cd redis_exporter_conf
2.3.1 配置抓取 redis 集群 配置文件
vim text_A_redis_cluaster.json

[
  {
    "targets": [ "redis://50.50.50.100:7000",
                 "redis://50.50.50.100:7001",
                 "redis://50.50.50.100:7002",
                 "redis://50.50.50.100:7003",
                 "redis://50.50.50.100:7004",
                 "redis://50.50.50.100:7005" ],
    "labels": { }
  }
]
2.3.2 配置抓取 redis 主从 配置文件
vim text_B_redis_sentinel.json

[
  {
    "targets": [ "redis://50.50.50.100:6379",
                 "redis://50.50.50.100:6380",
                 "redis://50.50.50.100:6381" ],
    "labels": { }
  }
]
  • 配置热加载无需重启 prometheus

2.4 浏览器访问 Prometheus

  • 浏览器访问 prometheus 查看 redis 存活状态
  • 查看 redis_exporter 导出的redis指标
2.4.1 查看 redis 存活状态

在这里插入图片描述

2.4.2 查看 redis_exporter 抓取到的 redis 指标

在这里插入图片描述

在这里插入图片描述

三、部署配置 Grafana + Prometheus 数据源

  • 部署 Grafana，使用 Prometheus 数据源 将 Prometheus 收集到的数据整合到 Grafana 进行展示

3.1 部署 Grafana

3.1.1 准备 rpm 安装包
https://grafana.com/grafana/download?pg=graf&plcmt=deploy-box-1

grafana-enterprise-8.5.2-1.x86_64.rpm
3.2.2 安装
yum install -y grafana-enterprise-8.5.2-1.x86_64.rpm
3.2.3 启动
systemctl start grafana-server.service

systemctl enable grafana-server.service

3.2 浏览器访问 Grafana

http://50.50.50.100:3000/

在这里插入图片描述

  • 关于 Grafana 的主题可以修改 default_theme 参数
  • 配置文件在 /etc/grafana/grafana.ini

3.3 Grafana 添加 Prometheus 数据源

在这里插入图片描述

在这里插入图片描述

在这里插入图片描述

在这里插入图片描述

在这里插入图片描述

3.4 添加仪表盘模板

  • 添加 redis_exporter 仪表盘展示模板
  • 我这里用的仪表盘模板 ID 763

在这里插入图片描述

在这里插入图片描述

在这里插入图片描述

在这里插入图片描述

四、自定义仪表盘

  • 添加面板使用 PromQL 语句实现 role、link、存活状态的展示

4.1 预览

在这里插入图片描述
在这里插入图片描述

4.2 自己配置仪表盘

4.2.1 配置 role 展示
count by (role) (redis_instance_info{instance=~"$instance"})

{{role}}

在这里插入图片描述
在这里插入图片描述

4.2.2 配置 master link 展示
redis_master_link_up{instance=~"$instance"}

master {{master_host}}:{{master_port}}

在这里插入图片描述在这里插入图片描述

4.2.3 配置 slave link 展示
redis_connected_slave_lag_seconds{instance=~"$instance"}

slave {{slave_ip}}:{{slave_port}}

在这里插入图片描述在这里插入图片描述

4.3 或者直接使用我的 JSON

{
  "__inputs": [
    {
      "name": "DS_业务",
      "label": "业务",
      "description": "",
      "type": "datasource",
      "pluginId": "prometheus",
      "pluginName": "Prometheus"
    }
  ],
  "__elements": [],
  "__requires": [
    {
      "type": "panel",
      "id": "gauge",
      "name": "Gauge",
      "version": ""
    },
    {
      "type": "grafana",
      "id": "grafana",
      "name": "Grafana",
      "version": "8.5.2"
    },
    {
      "type": "panel",
      "id": "graph",
      "name": "Graph (old)",
      "version": ""
    },
    {
      "type": "panel",
      "id": "piechart",
      "name": "Pie chart",
      "version": ""
    },
    {
      "type": "datasource",
      "id": "prometheus",
      "name": "Prometheus",
      "version": "1.0.0"
    },
    {
      "type": "panel",
      "id": "stat",
      "name": "Stat",
      "version": ""
    }
  ],
  "annotations": {
    "list": [
      {
        "builtIn": 1,
        "datasource": {
          "type": "datasource",
          "uid": "grafana"
        },
        "enable": true,
        "hide": true,
        "iconColor": "rgba(0, 211, 255, 1)",
        "name": "Annotations & Alerts",
        "target": {
          "limit": 100,
          "matchAny": false,
          "tags": [],
          "type": "dashboard"
        },
        "type": "dashboard"
      }
    ]
  },
  "description": "Redis Dashboard for Prometheus Redis Exporter 1.x",
  "editable": true,
  "fiscalYearStartMonth": 0,
  "gnetId": 763,
  "graphTooltip": 1,
  "id": null,
  "iteration": 1712656187874,
  "links": [],
  "liveNow": true,
  "panels": [
    {
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "fieldConfig": {
        "defaults": {
          "color": {
            "mode": "thresholds"
          },
          "mappings": [
            {
              "options": {
                "0": {
                  "color": "dark-red",
                  "index": 1
                },
                "1": {
                  "color": "dark-green",
                  "index": 0
                }
              },
              "type": "value"
            }
          ],
          "thresholds": {
            "mode": "absolute",
            "steps": [
              {
                "color": "green",
                "value": null
              }
            ]
          }
        },
        "overrides": []
      },
      "gridPos": {
        "h": 2,
        "w": 24,
        "x": 0,
        "y": 0
      },
      "id": 34,
      "options": {
        "colorMode": "background",
        "graphMode": "none",
        "justifyMode": "center",
        "orientation": "vertical",
        "reduceOptions": {
          "calcs": [],
          "fields": "",
          "values": false
        },
        "textMode": "none"
      },
      "pluginVersion": "8.5.2",
      "targets": [
        {
          "datasource": {
            "type": "prometheus",
            "uid": "${DS_业务}"
          },
          "editorMode": "code",
          "expr": "redis_up{namespace!=\"\"}",
          "legendFormat": "{{label_name}}",
          "range": true,
          "refId": "A"
        }
      ],
      "title": "整体存活状态",
      "type": "stat"
    },
    {
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "description": "",
      "fieldConfig": {
        "defaults": {
          "color": {
            "mode": "thresholds"
          },
          "mappings": [],
          "thresholds": {
            "mode": "absolute",
            "steps": [
              {
                "color": "green",
                "value": null
              }
            ]
          }
        },
        "overrides": []
      },
      "gridPos": {
        "h": 7,
        "w": 4,
        "x": 0,
        "y": 2
      },
      "id": 22,
      "options": {
        "colorMode": "none",
        "graphMode": "none",
        "justifyMode": "auto",
        "orientation": "horizontal",
        "reduceOptions": {
          "calcs": [],
          "fields": "",
          "values": false
        },
        "text": {
          "valueSize": 45
        },
        "textMode": "name"
      },
      "pluginVersion": "8.5.2",
      "targets": [
        {
          "datasource": {
            "type": "prometheus",
            "uid": "${DS_业务}"
          },
          "editorMode": "code",
          "expr": "count by (role) (redis_instance_info{instance=~\"$instance\"})",
          "legendFormat": "{{role}}",
          "range": true,
          "refId": "A"
        }
      ],
      "title": "角色",
      "type": "stat"
    },
    {
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "fieldConfig": {
        "defaults": {
          "color": {
            "mode": "thresholds"
          },
          "mappings": [
            {
              "options": {
                "0": {
                  "color": "dark-red",
                  "index": 1,
                  "text": "DOWN"
                },
                "1": {
                  "color": "dark-green",
                  "index": 0,
                  "text": "UP"
                }
              },
              "type": "value"
            }
          ],
          "thresholds": {
            "mode": "absolute",
            "steps": [
              {
                "color": "green",
                "value": null
              }
            ]
          }
        },
        "overrides": []
      },
      "gridPos": {
        "h": 7,
        "w": 6,
        "x": 4,
        "y": 2
      },
      "id": 28,
      "options": {
        "colorMode": "background",
        "graphMode": "none",
        "justifyMode": "center",
        "orientation": "horizontal",
        "reduceOptions": {
          "calcs": [],
          "fields": "",
          "values": false
        },
        "text": {
          "titleSize": 15,
          "valueSize": 15
        },
        "textMode": "auto"
      },
      "pluginVersion": "8.5.2",
      "targets": [
        {
          "datasource": {
            "type": "prometheus",
            "uid": "${DS_业务}"
          },
          "editorMode": "code",
          "expr": "redis_up{namespace=~\"$namespace\"}",
          "legendFormat": "{{instance}} ~❤️",
          "range": true,
          "refId": "A"
        }
      ],
      "title": "存活状态",
      "type": "stat"
    },
    {
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "description": "",
      "fieldConfig": {
        "defaults": {
          "color": {
            "mode": "thresholds"
          },
          "mappings": [],
          "thresholds": {
            "mode": "absolute",
            "steps": [
              {
                "color": "green",
                "value": null
              }
            ]
          }
        },
        "overrides": []
      },
      "gridPos": {
        "h": 7,
        "w": 7,
        "x": 10,
        "y": 2
      },
      "id": 24,
      "options": {
        "colorMode": "none",
        "graphMode": "none",
        "justifyMode": "auto",
        "orientation": "horizontal",
        "reduceOptions": {
          "calcs": [],
          "fields": "",
          "values": false
        },
        "text": {
          "valueSize": 30
        },
        "textMode": "name"
      },
      "pluginVersion": "8.5.2",
      "targets": [
        {
          "datasource": {
            "type": "prometheus",
            "uid": "${DS_业务}"
          },
          "editorMode": "code",
          "expr": "redis_master_link_up{instance=~\"$instance\", namespace=~\"$namespace\"}",
          "legendFormat": "master {{master_host}}:{{master_port}}",
          "range": true,
          "refId": "A"
        }
      ],
      "title": "主链接",
      "type": "stat"
    },
    {
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "fieldConfig": {
        "defaults": {
          "color": {
            "mode": "thresholds"
          },
          "mappings": [],
          "thresholds": {
            "mode": "absolute",
            "steps": [
              {
                "color": "green",
                "value": null
              }
            ]
          }
        },
        "overrides": []
      },
      "gridPos": {
        "h": 7,
        "w": 7,
        "x": 17,
        "y": 2
      },
      "id": 26,
      "options": {
        "colorMode": "none",
        "graphMode": "none",
        "justifyMode": "auto",
        "orientation": "horizontal",
        "reduceOptions": {
          "calcs": [],
          "fields": "",
          "values": false
        },
        "text": {
          "valueSize": 30
        },
        "textMode": "name"
      },
      "pluginVersion": "8.5.2",
      "targets": [
        {
          "datasource": {
            "type": "prometheus",
            "uid": "${DS_业务}"
          },
          "editorMode": "code",
          "expr": "redis_connected_slave_lag_seconds{instance=~\"$instance\", namespace=~\"$namespace\"}",
          "legendFormat": "slave {{slave_ip}}:{{slave_port}}",
          "range": true,
          "refId": "A"
        }
      ],
      "title": "从链接",
      "type": "stat"
    },
    {
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "fieldConfig": {
        "defaults": {
          "color": {
            "fixedColor": "rgb(31, 120, 193)",
            "mode": "fixed"
          },
          "decimals": 0,
          "mappings": [
            {
              "options": {
                "match": "null",
                "result": {
                  "text": "N/A"
                }
              },
              "type": "special"
            }
          ],
          "thresholds": {
            "mode": "absolute",
            "steps": [
              {
                "color": "green",
                "value": null
              },
              {
                "color": "red",
                "value": 80
              }
            ]
          },
          "unit": "s"
        },
        "overrides": []
      },
      "gridPos": {
        "h": 7,
        "w": 3,
        "x": 0,
        "y": 9
      },
      "id": 9,
      "links": [],
      "maxDataPoints": 100,
      "options": {
        "colorMode": "none",
        "graphMode": "area",
        "justifyMode": "auto",
        "orientation": "horizontal",
        "reduceOptions": {
          "calcs": [
            "lastNotNull"
          ],
          "fields": "",
          "values": false
        },
        "text": {
          "valueSize": 55
        },
        "textMode": "auto"
      },
      "pluginVersion": "8.5.2",
      "targets": [
        {
          "expr": "max(max_over_time(redis_uptime_in_seconds{instance=~\"$instance\"}[$__interval]))",
          "format": "time_series",
          "interval": "",
          "intervalFactor": 2,
          "legendFormat": "",
          "metric": "",
          "refId": "A",
          "step": 1800
        }
      ],
      "title": "最长正常运行时间",
      "type": "stat"
    },
    {
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "fieldConfig": {
        "defaults": {
          "color": {
            "fixedColor": "rgb(31, 120, 193)",
            "mode": "fixed"
          },
          "decimals": 0,
          "mappings": [
            {
              "options": {
                "match": "null",
                "result": {
                  "text": "N/A"
                }
              },
              "type": "special"
            }
          ],
          "thresholds": {
            "mode": "absolute",
            "steps": [
              {
                "color": "green",
                "value": null
              },
              {
                "color": "red",
                "value": 80
              }
            ]
          },
          "unit": "none"
        },
        "overrides": []
      },
      "gridPos": {
        "h": 7,
        "w": 5,
        "x": 3,
        "y": 9
      },
      "hideTimeOverride": true,
      "id": 12,
      "links": [],
      "maxDataPoints": 100,
      "options": {
        "colorMode": "none",
        "graphMode": "area",
        "justifyMode": "auto",
        "orientation": "horizontal",
        "reduceOptions": {
          "calcs": [
            "lastNotNull"
          ],
          "fields": "",
          "values": false
        },
        "text": {
          "valueSize": 60
        },
        "textMode": "auto"
      },
      "pluginVersion": "8.5.2",
      "targets": [
        {
          "expr": "sum(redis_connected_clients{instance=~\"$instance\"})",
          "format": "time_series",
          "intervalFactor": 2,
          "legendFormat": "",
          "metric": "",
          "refId": "A",
          "step": 2
        }
      ],
      "timeFrom": "1m",
      "title": "客户",
      "type": "stat"
    },
    {
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "fieldConfig": {
        "defaults": {
          "color": {
            "mode": "thresholds"
          },
          "decimals": 0,
          "mappings": [
            {
              "options": {
                "match": "null",
                "result": {
                  "text": "N/A"
                }
              },
              "type": "special"
            }
          ],
          "max": 100,
          "min": 0,
          "thresholds": {
            "mode": "absolute",
            "steps": [
              {
                "color": "rgba(50, 172, 45, 0.97)",
                "value": null
              },
              {
                "color": "rgba(237, 129, 40, 0.89)",
                "value": 80
              },
              {
                "color": "rgba(245, 54, 54, 0.9)",
                "value": 95
              }
            ]
          },
          "unit": "percent"
        },
        "overrides": []
      },
      "gridPos": {
        "h": 7,
        "w": 7,
        "x": 8,
        "y": 9
      },
      "hideTimeOverride": true,
      "id": 11,
      "links": [],
      "maxDataPoints": 100,
      "options": {
        "orientation": "horizontal",
        "reduceOptions": {
          "calcs": [
            "lastNotNull"
          ],
          "fields": "",
          "values": false
        },
        "showThresholdLabels": false,
        "showThresholdMarkers": true
      },
      "pluginVersion": "8.5.2",
      "targets": [
        {
          "datasource": {
            "type": "prometheus",
            "uid": "${DS_业务}"
          },
          "expr": "sum(100 * (redis_memory_used_bytes{instance=~\"$instance\"}  / redis_memory_max_bytes{instance=~\"$instance\"}))",
          "format": "time_series",
          "intervalFactor": 2,
          "legendFormat": "",
          "metric": "",
          "refId": "A",
          "step": 2
        }
      ],
      "timeFrom": "1m",
      "title": "内存使用情况",
      "type": "gauge"
    },
    {
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "fieldConfig": {
        "defaults": {
          "color": {
            "mode": "palette-classic"
          },
          "custom": {
            "hideFrom": {
              "legend": false,
              "tooltip": false,
              "viz": false
            }
          },
          "mappings": [
            {
              "options": {
                "0": {
                  "color": "dark-red",
                  "index": 0
                }
              },
              "type": "value"
            }
          ]
        },
        "overrides": []
      },
      "gridPos": {
        "h": 7,
        "w": 6,
        "x": 15,
        "y": 9
      },
      "id": 36,
      "options": {
        "legend": {
          "displayMode": "list",
          "placement": "bottom"
        },
        "pieType": "pie",
        "reduceOptions": {
          "calcs": [
            "lastNotNull"
          ],
          "fields": "",
          "values": false
        },
        "tooltip": {
          "mode": "single",
          "sort": "none"
        }
      },
      "pluginVersion": "8.5.2",
      "targets": [
        {
          "datasource": {
            "type": "prometheus",
            "uid": "${DS_业务}"
          },
          "editorMode": "code",
          "exemplar": false,
          "expr": "up{job_name=~\"\",namespace!=\"\"} !=1",
          "instant": false,
          "interval": "1s",
          "legendFormat": "{{namespace}} {{instance}}",
          "range": true,
          "refId": "A"
        }
      ],
      "title": "目标 Redis 是否可达",
      "transparent": true,
      "type": "piechart"
    },
    {
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "fieldConfig": {
        "defaults": {
          "color": {
            "mode": "thresholds"
          },
          "mappings": [],
          "thresholds": {
            "mode": "absolute",
            "steps": [
              {
                "color": "dark-blue",
                "value": null
              }
            ]
          }
        },
        "overrides": []
      },
      "gridPos": {
        "h": 3,
        "w": 3,
        "x": 21,
        "y": 9
      },
      "id": 30,
      "options": {
        "colorMode": "background",
        "graphMode": "none",
        "justifyMode": "auto",
        "orientation": "auto",
        "reduceOptions": {
          "calcs": [],
          "fields": "",
          "values": false
        },
        "text": {
          "valueSize": 40
        },
        "textMode": "name"
      },
      "pluginVersion": "8.5.2",
      "targets": [
        {
          "datasource": {
            "type": "prometheus",
            "uid": "${DS_业务}"
          },
          "editorMode": "code",
          "expr": "count by (redis_version) (redis_instance_info{instance=~\"$instance\", namespace=~\"$namespace\"})",
          "legendFormat": "{{redis_version}}",
          "range": true,
          "refId": "A"
        }
      ],
      "title": "版本号",
      "type": "stat"
    },
    {
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "fieldConfig": {
        "defaults": {
          "color": {
            "mode": "thresholds"
          },
          "mappings": [],
          "thresholds": {
            "mode": "absolute",
            "steps": [
              {
                "color": "dark-blue",
                "value": null
              }
            ]
          }
        },
        "overrides": []
      },
      "gridPos": {
        "h": 4,
        "w": 3,
        "x": 21,
        "y": 12
      },
      "id": 32,
      "options": {
        "colorMode": "background",
        "graphMode": "none",
        "justifyMode": "center",
        "orientation": "auto",
        "reduceOptions": {
          "calcs": [],
          "fields": "",
          "values": false
        },
        "text": {
          "valueSize": 30
        },
        "textMode": "name"
      },
      "pluginVersion": "8.5.2",
      "targets": [
        {
          "datasource": {
            "type": "prometheus",
            "uid": "${DS_业务}"
          },
          "editorMode": "code",
          "expr": "count by (maxmemory_policy) (redis_instance_info{instance=~\"$instance\", namespace=~\"$namespace\"})",
          "legendFormat": "{{maxmemory_policy}}",
          "range": true,
          "refId": "A"
        }
      ],
      "title": "驱逐策略",
      "type": "stat"
    },
    {
      "aliasColors": {},
      "bars": false,
      "dashLength": 10,
      "dashes": false,
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "editable": true,
      "error": false,
      "fieldConfig": {
        "defaults": {
          "links": []
        },
        "overrides": []
      },
      "fill": 8,
      "fillGradient": 0,
      "grid": {},
      "gridPos": {
        "h": 7,
        "w": 12,
        "x": 0,
        "y": 16
      },
      "hiddenSeries": false,
      "id": 18,
      "isNew": true,
      "legend": {
        "avg": false,
        "current": false,
        "hideEmpty": false,
        "hideZero": false,
        "max": false,
        "min": false,
        "show": false,
        "total": false,
        "values": false
      },
      "lines": true,
      "linewidth": 1,
      "links": [],
      "nullPointMode": "connected",
      "options": {
        "alertThreshold": true
      },
      "percentage": false,
      "pluginVersion": "8.5.2",
      "pointradius": 5,
      "points": false,
      "renderer": "flot",
      "seriesOverrides": [],
      "spaceLength": 10,
      "stack": true,
      "steppedLine": false,
      "targets": [
        {
          "datasource": {
            "type": "prometheus",
            "uid": "${DS_业务}"
          },
          "editorMode": "code",
          "expr": "sum(rate(redis_commands_total{instance=~\"$instance\"} [1m])) by (cmd)",
          "format": "time_series",
          "interval": "1s",
          "intervalFactor": 2,
          "legendFormat": "{{ cmd }}",
          "metric": "redis_command_calls_total",
          "range": true,
          "refId": "A",
          "step": 240
        }
      ],
      "thresholds": [],
      "timeRegions": [],
      "title": "命令总数/秒",
      "tooltip": {
        "msResolution": true,
        "shared": true,
        "sort": 2,
        "value_type": "individual"
      },
      "type": "graph",
      "xaxis": {
        "mode": "time",
        "show": true,
        "values": []
      },
      "yaxes": [
        {
          "format": "short",
          "logBase": 1,
          "show": true
        },
        {
          "format": "short",
          "logBase": 1,
          "show": true
        }
      ],
      "yaxis": {
        "align": false
      }
    },
    {
      "aliasColors": {},
      "bars": false,
      "dashLength": 10,
      "dashes": false,
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "decimals": 2,
      "editable": true,
      "error": false,
      "fieldConfig": {
        "defaults": {
          "links": []
        },
        "overrides": []
      },
      "fill": 1,
      "fillGradient": 0,
      "grid": {},
      "gridPos": {
        "h": 7,
        "w": 12,
        "x": 12,
        "y": 16
      },
      "hiddenSeries": false,
      "id": 1,
      "isNew": true,
      "legend": {
        "avg": false,
        "current": false,
        "max": false,
        "min": false,
        "show": false,
        "total": false,
        "values": false
      },
      "lines": true,
      "linewidth": 2,
      "links": [],
      "nullPointMode": "connected",
      "options": {
        "alertThreshold": true
      },
      "percentage": true,
      "pluginVersion": "8.5.2",
      "pointradius": 5,
      "points": false,
      "renderer": "flot",
      "seriesOverrides": [],
      "spaceLength": 10,
      "stack": false,
      "steppedLine": false,
      "targets": [
        {
          "expr": "irate(redis_keyspace_hits_total{instance=~\"$instance\"}[5m])",
          "format": "time_series",
          "hide": false,
          "interval": "",
          "intervalFactor": 2,
          "legendFormat": "hits, {{ instance }}",
          "metric": "",
          "refId": "A",
          "step": 240,
          "target": ""
        },
        {
          "expr": "irate(redis_keyspace_misses_total{instance=~\"$instance\"}[5m])",
          "format": "time_series",
          "hide": false,
          "interval": "",
          "intervalFactor": 2,
          "legendFormat": "misses, {{ instance }}",
          "metric": "",
          "refId": "B",
          "step": 240,
          "target": ""
        }
      ],
      "thresholds": [],
      "timeRegions": [],
      "title": "每秒命中/未命中",
      "tooltip": {
        "msResolution": false,
        "shared": true,
        "sort": 0,
        "value_type": "individual"
      },
      "type": "graph",
      "xaxis": {
        "mode": "time",
        "show": true,
        "values": []
      },
      "yaxes": [
        {
          "format": "short",
          "label": "",
          "logBase": 1,
          "min": 0,
          "show": true
        },
        {
          "format": "short",
          "logBase": 1,
          "show": true
        }
      ],
      "yaxis": {
        "align": false
      }
    },
    {
      "aliasColors": {
        "max": "#BF1B00"
      },
      "bars": false,
      "dashLength": 10,
      "dashes": false,
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "editable": true,
      "error": false,
      "fieldConfig": {
        "defaults": {
          "links": []
        },
        "overrides": []
      },
      "fill": 1,
      "fillGradient": 0,
      "grid": {},
      "gridPos": {
        "h": 7,
        "w": 12,
        "x": 0,
        "y": 23
      },
      "hiddenSeries": false,
      "id": 7,
      "isNew": true,
      "legend": {
        "avg": false,
        "current": false,
        "hideEmpty": false,
        "hideZero": false,
        "max": false,
        "min": false,
        "show": true,
        "total": false,
        "values": false
      },
      "lines": true,
      "linewidth": 2,
      "links": [],
      "nullPointMode": "null as zero",
      "options": {
        "alertThreshold": true
      },
      "percentage": false,
      "pluginVersion": "8.5.2",
      "pointradius": 5,
      "points": false,
      "renderer": "flot",
      "seriesOverrides": [],
      "spaceLength": 10,
      "stack": false,
      "steppedLine": false,
      "targets": [
        {
          "expr": "redis_memory_used_bytes{instance=~\"$instance\"}",
          "format": "time_series",
          "intervalFactor": 2,
          "legendFormat": "used, {{ instance }}",
          "metric": "",
          "refId": "A",
          "step": 240,
          "target": ""
        },
        {
          "expr": "redis_memory_max_bytes{instance=~\"$instance\"}",
          "format": "time_series",
          "hide": false,
          "intervalFactor": 2,
          "legendFormat": "max, {{ instance }}",
          "refId": "B",
          "step": 240
        }
      ],
      "thresholds": [],
      "timeRegions": [],
      "title": "总内存使用量",
      "tooltip": {
        "msResolution": false,
        "shared": true,
        "sort": 0,
        "value_type": "cumulative"
      },
      "type": "graph",
      "xaxis": {
        "mode": "time",
        "show": true,
        "values": []
      },
      "yaxes": [
        {
          "format": "bytes",
          "logBase": 1,
          "min": 0,
          "show": true
        },
        {
          "format": "short",
          "logBase": 1,
          "show": true
        }
      ],
      "yaxis": {
        "align": false
      }
    },
    {
      "aliasColors": {},
      "bars": false,
      "dashLength": 10,
      "dashes": false,
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "editable": true,
      "error": false,
      "fieldConfig": {
        "defaults": {
          "links": []
        },
        "overrides": []
      },
      "fill": 1,
      "fillGradient": 0,
      "grid": {},
      "gridPos": {
        "h": 7,
        "w": 12,
        "x": 12,
        "y": 23
      },
      "hiddenSeries": false,
      "id": 10,
      "isNew": true,
      "legend": {
        "avg": false,
        "current": false,
        "max": false,
        "min": false,
        "show": true,
        "total": false,
        "values": false
      },
      "lines": true,
      "linewidth": 2,
      "links": [],
      "nullPointMode": "connected",
      "options": {
        "alertThreshold": true
      },
      "percentage": false,
      "pluginVersion": "8.5.2",
      "pointradius": 5,
      "points": false,
      "renderer": "flot",
      "seriesOverrides": [],
      "spaceLength": 10,
      "stack": false,
      "steppedLine": false,
      "targets": [
        {
          "expr": "sum(rate(redis_net_input_bytes_total{instance=~\"$instance\"}[5m]))",
          "format": "time_series",
          "intervalFactor": 2,
          "legendFormat": "{{ input }}",
          "refId": "A",
          "step": 240
        },
        {
          "expr": "sum(rate(redis_net_output_bytes_total{instance=~\"$instance\"}[5m]))",
          "format": "time_series",
          "interval": "",
          "intervalFactor": 2,
          "legendFormat": "{{ output }}",
          "refId": "B",
          "step": 240
        }
      ],
      "thresholds": [],
      "timeRegions": [],
      "title": "网络 I/O",
      "tooltip": {
        "msResolution": true,
        "shared": true,
        "sort": 0,
        "value_type": "cumulative"
      },
      "type": "graph",
      "xaxis": {
        "mode": "time",
        "show": true,
        "values": []
      },
      "yaxes": [
        {
          "format": "bytes",
          "logBase": 1,
          "show": true
        },
        {
          "format": "short",
          "logBase": 1,
          "show": true
        }
      ],
      "yaxis": {
        "align": false
      }
    },
    {
      "aliasColors": {},
      "bars": false,
      "dashLength": 10,
      "dashes": false,
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "editable": true,
      "error": false,
      "fieldConfig": {
        "defaults": {
          "links": []
        },
        "overrides": []
      },
      "fill": 7,
      "fillGradient": 0,
      "grid": {},
      "gridPos": {
        "h": 7,
        "w": 12,
        "x": 0,
        "y": 30
      },
      "hiddenSeries": false,
      "id": 5,
      "isNew": true,
      "legend": {
        "alignAsTable": false,
        "avg": false,
        "current": true,
        "hideEmpty": false,
        "hideZero": true,
        "max": false,
        "min": false,
        "rightSide": false,
        "show": true,
        "total": false,
        "values": true
      },
      "lines": true,
      "linewidth": 2,
      "links": [],
      "nullPointMode": "connected",
      "options": {
        "alertThreshold": true
      },
      "percentage": false,
      "pluginVersion": "8.5.2",
      "pointradius": 5,
      "points": false,
      "renderer": "flot",
      "seriesOverrides": [],
      "spaceLength": 10,
      "stack": true,
      "steppedLine": false,
      "targets": [
        {
          "expr": "sum (redis_db_keys{instance=~\"$instance\"}) by (db, instance)",
          "format": "time_series",
          "interval": "",
          "intervalFactor": 2,
          "legendFormat": "{{ db }}, {{ instance }}",
          "refId": "A",
          "step": 240,
          "target": ""
        }
      ],
      "thresholds": [],
      "timeRegions": [],
      "title": "每个数据库的项目总数",
      "tooltip": {
        "msResolution": false,
        "shared": true,
        "sort": 0,
        "value_type": "individual"
      },
      "type": "graph",
      "xaxis": {
        "mode": "time",
        "show": true,
        "values": []
      },
      "yaxes": [
        {
          "format": "none",
          "logBase": 1,
          "show": true
        },
        {
          "format": "short",
          "logBase": 1,
          "show": true
        }
      ],
      "yaxis": {
        "align": false
      }
    },
    {
      "aliasColors": {},
      "bars": false,
      "dashLength": 10,
      "dashes": false,
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "editable": true,
      "error": false,
      "fieldConfig": {
        "defaults": {
          "links": []
        },
        "overrides": []
      },
      "fill": 7,
      "fillGradient": 0,
      "grid": {},
      "gridPos": {
        "h": 7,
        "w": 12,
        "x": 12,
        "y": 30
      },
      "hiddenSeries": false,
      "id": 13,
      "isNew": true,
      "legend": {
        "avg": false,
        "current": false,
        "max": false,
        "min": false,
        "show": true,
        "total": false,
        "values": false
      },
      "lines": true,
      "linewidth": 2,
      "links": [],
      "nullPointMode": "connected",
      "options": {
        "alertThreshold": true
      },
      "percentage": false,
      "pluginVersion": "8.5.2",
      "pointradius": 5,
      "points": false,
      "renderer": "flot",
      "seriesOverrides": [],
      "spaceLength": 10,
      "stack": true,
      "steppedLine": false,
      "targets": [
        {
          "expr": "sum (redis_db_keys{instance=~\"$instance\"}) by (instance) - sum (redis_db_keys_expiring{instance=~\"$instance\"}) by (instance)",
          "format": "time_series",
          "interval": "",
          "intervalFactor": 2,
          "legendFormat": "not expiring, {{ instance }}",
          "refId": "A",
          "step": 240,
          "target": ""
        },
        {
          "expr": "sum (redis_db_keys_expiring{instance=~\"$instance\"}) by (instance)",
          "format": "time_series",
          "interval": "",
          "intervalFactor": 2,
          "legendFormat": "expiring, {{ instance }}",
          "metric": "",
          "refId": "B",
          "step": 240
        }
      ],
      "thresholds": [],
      "timeRegions": [],
      "title": "即将过期的密钥与未过期的密钥",
      "tooltip": {
        "msResolution": false,
        "shared": true,
        "sort": 0,
        "value_type": "individual"
      },
      "type": "graph",
      "xaxis": {
        "mode": "time",
        "show": true,
        "values": []
      },
      "yaxes": [
        {
          "format": "short",
          "logBase": 1,
          "show": true
        },
        {
          "format": "short",
          "logBase": 1,
          "show": true
        }
      ],
      "yaxis": {
        "align": false
      }
    },
    {
      "aliasColors": {
        "evicts": "#890F02",
        "memcached_items_evicted_total{instance=\"172.17.0.1:9150\",job=\"prometheus\"}": "#890F02",
        "reclaims": "#3F6833"
      },
      "bars": false,
      "dashLength": 10,
      "dashes": false,
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "editable": true,
      "error": false,
      "fieldConfig": {
        "defaults": {
          "links": []
        },
        "overrides": []
      },
      "fill": 1,
      "fillGradient": 0,
      "grid": {},
      "gridPos": {
        "h": 7,
        "w": 12,
        "x": 0,
        "y": 37
      },
      "hiddenSeries": false,
      "id": 8,
      "isNew": true,
      "legend": {
        "avg": false,
        "current": false,
        "max": false,
        "min": false,
        "show": true,
        "total": false,
        "values": false
      },
      "lines": true,
      "linewidth": 2,
      "links": [],
      "nullPointMode": "connected",
      "options": {
        "alertThreshold": true
      },
      "percentage": false,
      "pluginVersion": "8.5.2",
      "pointradius": 5,
      "points": false,
      "renderer": "flot",
      "seriesOverrides": [
        {
          "alias": "reclaims",
          "yaxis": 2
        }
      ],
      "spaceLength": 10,
      "stack": false,
      "steppedLine": false,
      "targets": [
        {
          "expr": "sum(rate(redis_expired_keys_total{instance=~\"$instance\"}[5m])) by (instance)",
          "format": "time_series",
          "hide": false,
          "interval": "",
          "intervalFactor": 2,
          "legendFormat": "expired, {{ instance }}",
          "metric": "",
          "refId": "A",
          "step": 240,
          "target": ""
        },
        {
          "expr": "sum(rate(redis_evicted_keys_total{instance=~\"$instance\"}[5m])) by (instance)",
          "format": "time_series",
          "interval": "",
          "intervalFactor": 2,
          "legendFormat": "evicted, {{ instance }}",
          "refId": "B",
          "step": 240
        }
      ],
      "thresholds": [],
      "timeRegions": [],
      "title": "过期/逐出的密钥",
      "tooltip": {
        "msResolution": false,
        "shared": true,
        "sort": 0,
        "value_type": "cumulative"
      },
      "type": "graph",
      "xaxis": {
        "mode": "time",
        "show": true,
        "values": []
      },
      "yaxes": [
        {
          "format": "short",
          "logBase": 1,
          "show": true
        },
        {
          "format": "short",
          "logBase": 1,
          "show": true
        }
      ],
      "yaxis": {
        "align": false
      }
    },
    {
      "aliasColors": {},
      "bars": false,
      "dashLength": 10,
      "dashes": false,
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "fieldConfig": {
        "defaults": {
          "links": []
        },
        "overrides": []
      },
      "fill": 1,
      "fillGradient": 0,
      "gridPos": {
        "h": 7,
        "w": 12,
        "x": 12,
        "y": 37
      },
      "hiddenSeries": false,
      "id": 16,
      "legend": {
        "avg": false,
        "current": false,
        "max": false,
        "min": false,
        "show": true,
        "total": false,
        "values": false
      },
      "lines": true,
      "linewidth": 1,
      "links": [],
      "nullPointMode": "null",
      "options": {
        "alertThreshold": true
      },
      "percentage": false,
      "pluginVersion": "8.5.2",
      "pointradius": 2,
      "points": false,
      "renderer": "flot",
      "seriesOverrides": [],
      "spaceLength": 10,
      "stack": false,
      "steppedLine": false,
      "targets": [
        {
          "expr": "sum(redis_connected_clients{instance=~\"$instance\"})",
          "format": "time_series",
          "intervalFactor": 1,
          "legendFormat": "connected",
          "refId": "A"
        },
        {
          "expr": "sum(redis_blocked_clients{instance=~\"$instance\"})",
          "format": "time_series",
          "intervalFactor": 1,
          "legendFormat": "blocked",
          "refId": "B"
        }
      ],
      "thresholds": [],
      "timeRegions": [],
      "title": "已连接/阻止的客户端",
      "tooltip": {
        "shared": true,
        "sort": 0,
        "value_type": "individual"
      },
      "type": "graph",
      "xaxis": {
        "mode": "time",
        "show": true,
        "values": []
      },
      "yaxes": [
        {
          "format": "short",
          "logBase": 1,
          "show": true
        },
        {
          "format": "short",
          "logBase": 1,
          "show": true
        }
      ],
      "yaxis": {
        "align": false
      }
    },
    {
      "aliasColors": {},
      "bars": false,
      "dashLength": 10,
      "dashes": false,
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "editable": true,
      "error": false,
      "fieldConfig": {
        "defaults": {
          "links": []
        },
        "overrides": []
      },
      "fill": 2,
      "fillGradient": 0,
      "grid": {},
      "gridPos": {
        "h": 7,
        "w": 12,
        "x": 0,
        "y": 44
      },
      "hiddenSeries": false,
      "id": 20,
      "isNew": true,
      "legend": {
        "avg": false,
        "current": false,
        "hideEmpty": false,
        "hideZero": true,
        "max": false,
        "min": false,
        "show": true,
        "total": false,
        "values": false
      },
      "lines": true,
      "linewidth": 1,
      "links": [],
      "nullPointMode": "connected",
      "options": {
        "alertThreshold": true
      },
      "percentage": false,
      "pluginVersion": "8.5.2",
      "pointradius": 5,
      "points": false,
      "renderer": "flot",
      "seriesOverrides": [],
      "spaceLength": 10,
      "stack": false,
      "steppedLine": false,
      "targets": [
        {
          "expr": "sum(irate(redis_commands_duration_seconds_total{instance =~ \"$instance\"}[1m])) by (cmd)\n  /\nsum(irate(redis_commands_total{instance =~ \"$instance\"}[1m])) by (cmd)\n",
          "format": "time_series",
          "interval": "",
          "intervalFactor": 2,
          "legendFormat": "{{ cmd }}",
          "metric": "redis_command_calls_total",
          "refId": "A",
          "step": 240
        }
      ],
      "thresholds": [],
      "timeRegions": [],
      "title": "命令/秒的平均花费时间",
      "tooltip": {
        "msResolution": true,
        "shared": true,
        "sort": 2,
        "value_type": "individual"
      },
      "type": "graph",
      "xaxis": {
        "mode": "time",
        "show": true,
        "values": []
      },
      "yaxes": [
        {
          "format": "s",
          "logBase": 1,
          "show": true
        },
        {
          "format": "short",
          "logBase": 1,
          "show": true
        }
      ],
      "yaxis": {
        "align": false
      }
    },
    {
      "aliasColors": {},
      "bars": false,
      "dashLength": 10,
      "dashes": false,
      "datasource": {
        "type": "prometheus",
        "uid": "${DS_业务}"
      },
      "editable": true,
      "error": false,
      "fieldConfig": {
        "defaults": {
          "links": []
        },
        "overrides": []
      },
      "fill": 8,
      "fillGradient": 0,
      "grid": {},
      "gridPos": {
        "h": 7,
        "w": 12,
        "x": 12,
        "y": 44
      },
      "hiddenSeries": false,
      "id": 14,
      "isNew": true,
      "legend": {
        "avg": false,
        "current": false,
        "hideEmpty": false,
        "hideZero": false,
        "max": false,
        "min": false,
        "show": true,
        "total": false,
        "values": false
      },
      "lines": true,
      "linewidth": 1,
      "links": [],
      "nullPointMode": "connected",
      "options": {
        "alertThreshold": true
      },
      "percentage": false,
      "pluginVersion": "8.5.2",
      "pointradius": 5,
      "points": false,
      "renderer": "flot",
      "seriesOverrides": [],
      "spaceLength": 10,
      "stack": true,
      "steppedLine": false,
      "targets": [
        {
          "expr": "sum(irate(redis_commands_duration_seconds_total{instance=~\"$instance\"}[1m])) by (cmd) != 0",
          "format": "time_series",
          "interval": "",
          "intervalFactor": 2,
          "legendFormat": "{{ cmd }}",
          "metric": "redis_command_calls_total",
          "refId": "A",
          "step": 240
        }
      ],
      "thresholds": [],
      "timeRegions": [],
      "title": "命令所花费的总时间/秒",
      "tooltip": {
        "msResolution": true,
        "shared": true,
        "sort": 2,
        "value_type": "individual"
      },
      "type": "graph",
      "xaxis": {
        "mode": "time",
        "show": true,
        "values": []
      },
      "yaxes": [
        {
          "format": "s",
          "logBase": 1,
          "show": true
        },
        {
          "format": "short",
          "logBase": 1,
          "show": true
        }
      ],
      "yaxis": {
        "align": false
      }
    }
  ],
  "refresh": "5s",
  "schemaVersion": 36,
  "style": "dark",
  "tags": [
    "prometheus",
    "redis"
  ],
  "templating": {
    "list": [
      {
        "current": {},
        "datasource": {
          "type": "prometheus",
          "uid": "${DS_业务}"
        },
        "definition": "label_values(redis_up, namespace)",
        "hide": 0,
        "includeAll": false,
        "multi": false,
        "name": "namespace",
        "options": [],
        "query": {
          "query": "label_values(redis_up, namespace)",
          "refId": "Prometheus-namespace-Variable-Query"
        },
        "refresh": 2,
        "regex": "",
        "skipUrlSync": false,
        "sort": 1,
        "tagValuesQuery": "",
        "tagsQuery": "",
        "type": "query",
        "useTags": false
      },
      {
        "current": {},
        "datasource": {
          "type": "prometheus",
          "uid": "${DS_业务}"
        },
        "definition": "label_values(redis_up{namespace=~\"$namespace\"}, instance)",
        "hide": 0,
        "includeAll": false,
        "multi": true,
        "name": "instance",
        "options": [],
        "query": {
          "query": "label_values(redis_up{namespace=~\"$namespace\"}, instance)",
          "refId": "Prometheus-instance-Variable-Query"
        },
        "refresh": 2,
        "regex": "",
        "skipUrlSync": false,
        "sort": 1,
        "tagValuesQuery": "",
        "tagsQuery": "",
        "type": "query",
        "useTags": false
      }
    ]
  },
  "time": {
    "from": "now-1m",
    "to": "now"
  },
  "timepicker": {
    "refresh_intervals": [
      "5s",
      "10s",
      "30s",
      "1m",
      "5m",
      "15m",
      "30m",
      "1h",
      "2h",
      "1d"
    ],
    "time_options": [
      "5m",
      "15m",
      "1h",
      "6h",
      "12h",
      "24h",
      "2d",
      "7d",
      "30d"
    ]
  },
  "timezone": "browser",
  "title": "业务",
  "uid": "1",
  "version": 46,
  "weekStart": ""
}

五、多业务多集群分组管理

  • 配置 Prometheus 命名空间进行分组管理
  • 修改自定义面板 PromQL 语句

5.1 预览

在这里插入图片描述
在这里插入图片描述
在这里插入图片描述

5.2 配置 namespace

cd /usr/local/prometheus/prometheus-2.45.2/redis_exporter_conf

vim text_A_redis_cluaster.json

[
  {
    "targets": [ "redis://50.50.50.100:7000",
                 "redis://50.50.50.100:7001",
                 "redis://50.50.50.100:7002",
                 "redis://50.50.50.100:7003",
                 "redis://50.50.50.100:7004",
                 "redis://50.50.50.100:7005" ],
    "labels": {"namespace": "text_A_cluaster"}
  }
]

vim text_B_redis_sentinel.json

[
  {
    "targets": [ "redis://50.50.50.100:6379",
                 "redis://50.50.50.100:6380",
                 "redis://50.50.50.100:6381" ],
    "labels": {"namespace": "text_B_sentinel"}
  }
]

5.3 修改 PromQL 语句

  • 修改 master slave link 面板查询语句
redis_master_link_up{instance=~"$instance", namespace=~"$namespace"}

redis_connected_slave_lag_seconds{instance=~"$instance", namespace=~"$namespace"}

▶ Grafana + Redis 数据源 监控 Redis

一、部署 Grafana + Redis 数据源插件

1.1 部署 Grafana

  • 部署 grafana 用于展示和可视化监控数据，它提供了一个直观的用户界面，可以通过仪表盘和图表来展示从 prometheus 收集到的数据
1.1.1 准备 rpm 安装包
https://grafana.com/grafana/download?pg=graf&plcmt=deploy-box-1

grafana-enterprise-8.5.2-1.x86_64.rpm
1.1.2 安装
yum install -y grafana-enterprise-8.5.2-1.x86_64.rpm
1.1.3 启动
systemctl start grafana-server.service

systemctl enable grafana-server.service
1.1.4 浏览器访问 Grafana
http://50.50.50.100:3000/

在这里插入图片描述

1.2 安装 Redis 数据源插件

  • 安装 redis 数据源插件用于将 redis 中的数据可视化展示为各种图表和仪表盘
https://grafana.com/grafana/plugins/redis-datasource/?tab=installation

grafana-cli plugins install redis-datasource # 使用 grafana-cli 工具从命令行安装 redis

二、Grafana 配置添加 Redis 数据源

2.1 配置 Redis数据源

在这里插入图片描述

  • 配置都差不多，我这里就只添加个 redis 集群 的监控了

在这里插入图片描述

2.2 添加仪表盘

在这里插入图片描述

在这里插入图片描述

在这里插入图片描述
在这里插入图片描述

仙长道号-Linux真人
关注
  • 45
    点赞
  • 踩
  • 29
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
prometheus redis_exporter
11-27
prometheus监控虚拟机redis服务安装包，promethues官方网站没有提供redis_exporter安装包，下载该压缩包，解压之后即可使用
使用Node-red和Grafana可视化Lora Node数据-项目开发
03-30
本教程展示了如何使用从LoRa节点收集的数据来绘制精美的图形，以及如何使用Node-red和Grafana进行可视化。
prometheus+grafana+全方位立体监控redis
codeSmart的博客
02-07 2877
Prometheus 概述 Prometheus（普罗米修斯）是一套开源的监控&报警&时间序列数据库的组合，起始是由SoundCloud公司开发的。随着发展，越来越多公司和组织接受采用Prometheus，社会也十分活跃，他们便将它独立成开源项目，并且有公司来运作。Google SRE的书内也曾提到跟他们BorgMon监控系统相似的实现是Prometheus。现在最常见的Kubernetes容器管理系统中，通常会搭配Prometheus进行监控。 Prometheus基本原理是通过HTTP协
Redis监控 Prometheus + redis_exporter + Grafana 一键部署脚本
a1808862593的博客
02-23 420
此脚本实现将目标 Redis（ip:port）定义到脚本变量一键部署配置。脚本执行后只需自行添加 Grafana 的仪表盘。
Docker实现Prometheus监控redis+grafana图形展示
weixin_45948320的博客
12-24 789
文章目录首先在系统中安装Docker安装成功后查看版本：设置镜像源重启Docker:随后拉取Prometheus的Docker镜像：监控redis例子拉取镜像启动redis:启动redis状态收集器运行docker ps 查看服务：随后创建prometheus的配置文件配置下面代码：启动Prometheus浏览器查看界面重启prometheus服务：使用grafana图形化导入数据：选择prometheus配置prometheus地址和端口：导入redis 模板随后就能以图形化界面来监控服务了： 本次我们利
redis可视化监控：redis_exporter+prometheus+grafana
西凉的悲伤博客
01-21 6050
redis可视化监控：redis_exporter+prometheus+grafana
八、Prometheus监控Redis集群+Grafana实现可视化（图文详解！）
weixin_42230348的博客
09-02 3962
文章目录1、下载redis_exporter组件包2、解压并启动redis_exporter3、浏览器查看redis_exporter抓取到的redis相关指标： http://xx.xx.xx.xx:9121/4、在prometheus.yml配置5、重启prometheus，在浏览器中验证redis_exporter是否配置成功。6、Grafana实现可视化 1、下载redis_exporter组件包 wget https://github.com/oliver006/redis_exporter/re
Grafana监控 Redis Cluster
Sajor的博客
08-13 1282
使用grafana来实现监控，grafana可以对接多种数据源，在官网中可以找到Redis数据源，需要安装插件。当然也可以利用Prometheus来做数据源，下面分别记录一下这两种数据源的安装配置过程。
Grafana 如何监控redis性能指标
洪晓鸿
03-26 1501
Grafana 如何监控redis性能指标
Grafana+Prometheus系统监控之Redis
qq_39093474的博客
04-05 1653
虽然zabbix可以监控redis和其他组件的各项指标，但是zabbix的页面展示不如grafana的页面好看，所以这里我们来展示grafana的dashboard页面对于redis的监控将会使用到以下组件grafana、prometheus以及redis_exporter。
Prometheus+Grafana+node+mysql+tomcat部署监控系统.docx
06-18
Prometheus + Grafana+mysql_exporter + node_exporter + tomcat_exporter+jmx_exporter + nginx-vts-exporter+redis_exporter + alertmanager+《部署实时监控系统》 一、Prometheus介绍 3 二、Prometheus架构概览 ...
grafana、prometheus、node-exporte、redis-exporter
最新发布
04-09
grafana、prometheus、node-exporte、redis-exporter
prometheus监控redis和报警规则详细资料—超级详细(带文档和软件包)
06-04
prometheus监控redis和报警规则详细资料，带部署文档和相关软件包，能顺利部署和学习
redis_exporter：用于Redis度量标准的Prometheus导出器。 支持Redis 2.x，3.x，4.x，5.x和6.x
02-04
Prometheus Redis指标导出器 用于Redis指标的Prometheus导出器。 支持Redis 2.x，3.x，4.x，5.x和6.x建立并运行出口商在本地构建和运行git clone ...
使用Prometheus和Grafana构建Redis实时监控平台
Docker的专栏
10-03 475
Redis作为缓存系统，在整个后端体系中是较为重要的一环，需要实时监控运行状态。现在有各种各样的工具都可以对Redis进行监控，例如：redis-stat、RedisLive等，在使用过...
运维监控系列（7）-Prometheus+Grafana监控数据库MySql、Redis、Elasticsearch
记录知识、锤炼自我
09-17 600
前言 Mysql和Redis 是我们用的比较多的数据库，Prometheus也提供了支持。 MySql 官网也提供了mysqld_exporter。 mysqld_exporter不依赖于主机环境，只需要数据库的连接信息即可。所以这里使用Docker安装方式。 支持的版本： MySQL >= 5.6。 MariaDB >= 10.2 注意：MySQL/MariaDB < 5.6 不支持所有收集方法。 1. Docker 安装mysqld_exporter 注意DATA_SOURCE_
Prometheus+Grafana可视化监控【Redis状态】
秦子腾
09-16 765
注意：我这里使用之前写好脚本进行安装Docker，如果已经有Docker请省略此步骤，安装Docker是为了方便部署Redis数据库，如果已经有数据库前两步骤都可以省略。显示如上图，表示Prometheus也没问题了，默认端口是9090，我们可以浏览器访问一下。4、Prometheus配置文件中指定redis_exporter信息。1、安装redis_exporter。2、安装Prometheus。3、配置systemd管理。2、配置systemd管理。4、启动并设置开机自启。1、安装Grafana。
prometheus + grafana 监控Mysql、主机、Redis超简入门
yichen0429的博客
03-29 2466
prometheus + grafana 监控mysql、主机
学习笔记—Grafana监控docker--mysql/redis/rabbitMQ
qq_37405087的博客
06-24 3337
mysql、redis、rabbitMQ的性能测试学习
grafana监控多主机mysql_Prometheus+Grafana监控MySQL、Redis数据库
06-02
好的，您想了解关于使用Prometheus和Grafana监控多主机的MySQL和Redis数据库的方法。首先，您需要安装和配置Prometheus和Grafana。接下来，您需要配置Prometheus以收集MySQL和Redis数据库的指标。您可以使用Prometheus的exporter来收集MySQL和Redis数据库的指标。 对于MySQL数据库，您可以使用Prometheus的MySQL exporter。您需要在每个MySQL数据库服务器上安装和配置MySQL exporter。安装完成后，您需要在Prometheus的配置文件中添加MySQL exporter的目标。配置文件示例如下： ``` - job_name: 'mysql' static_configs: - targets: ['mysql-exporter:9104'] ``` 对于Redis数据库，您可以使用Prometheus的Redis exporter。您需要在每个Redis数据库服务器上安装和配置Redis exporter。安装完成后，您需要在Prometheus的配置文件中添加Redis exporter的目标。配置文件示例如下： ``` - job_name: 'redis' static_configs: - targets: ['redis-exporter:9121'] ``` 完成上述配置后，您可以使用Grafana来展示MySQL和Redis数据库的指标。您可以使用Grafana的模板来创建MySQL和Redis数据库的仪表盘。为了展示多个MySQL和Redis数据库的指标，您需要使用Grafana的变量功能。变量可以帮助您动态地切换不同的MySQL和Redis数据库。 希望以上信息能够对您有所帮助！

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值