prometheus + grafana相关监控服务的安装

prometheus官方网站：
exporter:https://prometheus.io/docs/instrumenting/exporters/

下载并安装Prometheus:
tar -zxvf prometheus-2.23.0.linux-amd64.tar.gz
mv prometheus-2.23.0.linux-amd64 /usr/local/prometheus
cd /usr/local/prometheus
/usr/local/prometheus/prometheus --help
数据存储的目录： --storage.tsdb.path=“data/”
存储时间： --storage.tsdb.retention

启动服务测试：/usr/local/prometheus/prometheus --config.file=“prometheus.yml”

配置相关系统服务，放在后台启动：
cd /usr/lib/systemd/system
cp sshd.service prometheus.service

vim prometheus.service
[Unit]
Description=https://prometheus.io
[Service]
Restart=on-failure
ExecStart=/usr/local/prometheus/prometheus --config.file=/usr/local/prometheus/prometheus.yml
[Install]
WantedBy=multi-user.target

systemctl daemon-reload
systemctl start prometheus

修改prometheus.yml配置文件
vim /usr/local/prometheus/prometheus.yml
scrape_configs:
- job_name: ‘prometheus’
static_configs:
- targets: [‘安装prometheus服务的IP:9090’] //9090为Prometheus默认的端口

修改了prometheus.yml配置文件
检测配置文件是否有问题：/usr/local/prometheus/promtool check config prometheus.yml
热更新：ps -ef| grep promet 得到 pid => kill -hup pid

安装node_exporter，监控Linux服务器
在需要监控的所有服务器上，下载并安装node_exporter
tar -zxvf node_exporter-1.0.1.linux-amd64.tar.gz
mv node_exporter-1.0.1.linux-amd64 /usr/local/node_exporter
配置后台启动：
vim /usr/lib/system/system/node_exporter.service
[Unit]
Description=https://prometheus.io
[Service]
Restart=on-failure
ExecStart=/usr/local/node_exporter/node_exporter
[Install]
WantedBy=multi-user.target

systemctl daemon-reload
systemctl start node_exporter

在安装了Prometheus服务的服务器上，修改prometheus.yml文件，添加node_exporter相关信息

动态增加监控目标：
vim /usr/local/prometheus/sd_config/node.yml
- targets:
- 安装了node_exporter服务的服务器IP:9400 //9400为node_exporter默认端口
- 安装了node_exporter服务的服务器IP:9400
- 安装了node_exporter服务的服务器IP:9400

vim /usr/local/prometheus/prometheus.yml
添加：
- job_name: ‘node’
file_sd_configs:
- files: [‘/usr/local/prometheus/sd_config/node.yml’]
refresh_interval: 5s

安装grafana
下载grafana-7.3.5-1.x86_64.rpm
安装：rpm -ivh grafana-7.3.5-1.x86_64.rpm
启动并登录网页：
service grafana-server start

安装Clickhouse-exporter

安装Docker-compose
curl -L https://github.com/docker/compose/releases/download/1.27.4/docker-compose-Linux-x86_64 -o /usr/local/bin/docker-compose
cd /usr/local/bin/docker-compose
vim docker-compose.yml

version: ‘3.8’
services:
clickhouse-exporter:
image: f1yegor/clickhouse-exporter:latest
restart: always
network_mode: host
container_name: clickhouse-exporter
ports:
- “9116:9116”
environment:
- CLICKHOUSE_USER=root
- CLICKHOUSE_PASSWORD=kD0OxTAe
####此处为命令行启动docker时添加的参数，即和docker run xxxx -scrape_url=//xxx.xxx.xxx.xxx:xxxx等价
# # # # # ###写CK的host:port
command: -scrape_uri=http://host:port
运行：docker-compose up -d
在安装prometheus的服务器上，vim prometheus.yml

• job_name: ‘clickhouse’
  scrape_interval: 5s
  static_configs:
  • targets: [‘host:9116’]