curator工具是es准备的命令行工具,为了更加方便的做清除数据,合并段等数据管理任务。
1).安装:
# 因为curator是python写的所以需要安装python及python-pip,
查看python版本python --version 查看pip版本 pip --version
安装python-pip:
wget https://bootstrap.pypa.io/get-pip.py --no-check-certificate
python get-pip.py
# 安装当前版本curator
pip install elasticsearch-curator
2).curator运行需两个配置文件config.yml(用于连接ES集群配置)、action.yml(用于配置要执行的操作),文件名称可以随意命名
config.yml样例:
---
client:
hosts:
- 172.20.11.19
port: 9200
url_prefix:
use_ssl: False
certificate:
client_cert:
client_key:
ssl_no_validate: False
http_auth:
timeout: 30
master_only: False
logging:
loglevel: INFO
logfile: run.log
logformat: default
blacklist: ['elasticsearch', 'urllib3']
action.yml样例(删除3天前的数据):
---
actions:
1:
action: delete_indices
description: >-
Delete metric indices older than 3 days.
options:
ignore_empty_list: True
# disable_action: True
filters:
- filtertype: pattern
kind: regex
value: '^(ep_service_ad_effect-).*$'
- filtertype: age
source: name
direction: older
timestring: '%Y-%m-%d'
unit: days
unit_count: 3
运行命令: curator --config d://config.yml d://action.yml
实际生产环境中可以设置linux的cron定时任务 定期执行任务 删除过期索引
crontab -e
#添加如下配置,每天0时运行一次
0 0 */1 * * curator --config /opt/elasticsearch-curator/config.yml /opt/elasticsearch-curator/action.yml