ELK官网 :https://www.elastic.co/cn/downloads/beats/filebeat
官网是学习一门新技术的百科全书,要想学习什么东西首先去官网翻一翻,就会发现很多自己很多想要知道的知识点
1、安装(系统ubuntu:16.04)
根据不同系统的安装步骤是不同的,在我这里看不明白的可以参考以下两个网址
https://www.elastic.co/guide/en/beats/libbeat/5.1/setup-repositories.html
https://yusure.cn/backend/332.html
具体步骤
(1)wget -qO - https://artifacts.elastic.co/GPG-KEY-elasticsearch | sudo apt-key add -
(2)sudo apt-get install apt-transport-https
(3)echo "deb https://artifacts.elastic.co/packages/5.x/apt stable main" | sudo tee -a /etc/apt/sources.list.d/elastic-5.x.list
(4)sudo apt-get update && sudo apt-get install filebeat
(5)安装成功后是放在/etc/filebeat下
另一种方式 (同样可行,亲试)
(1)curl -L -O https://artifacts.elastic.co/downloads/beats/filebeat/filebeat-6.5.4-amd64.deb
(2)sudo dpkg -i filebeat-6.5.4-amd64.deb
2、使用
(1)先说明filebeat中的各种文件路径
Home path: [/usr/share/filebeat] Config path: [/etc/filebeat] Data path: [/var/lib/filebeat] Logs path: [/var/log/filebeat]
(2) 修改配置文件/etc/filebeat/filebeat.yml(注意空格)
filebeat.inputs:
- type: log
enabled: true
paths:
- /opt/log/*.log
output.file:
path: "/opt/filebeat"
filename: filebeat
这里的配置设置是指使用filebeat监控/opt/log/下的所有日志文件,发生日志变动时会检测到并且发送消息,持久化到/opt/filebeat下。
(3)开启
/etc/init.d/filebeat start /stop/status/restart
(4)测试
mkdir /opt/log
touch /opt/log/test.log
echo "666" >> /opt/log/test.log
(5)查看/opt/filebeat下的日志文件,会在文件中出现刚才log文件中的新数据,并且在配置文件中offset会相应的改变,下面看一条记录
{"@timestamp":"2019-07-25T03:14:28.240Z","@metadata":{"beat":"filebeat","type":"_doc","version":"7.2.0"},"log":{"offset":246,"file":{"path":"/opt/log/aa.log"}},"message":"666","input":{"type":"log"},"host":{"name":"5b17902c8914"},"agent":{"id":"0c2636c2-9665-45ff-8f91-75d2b238ee32","version":"7.2.0","type":"filebeat","ephemeral_id":"68656f80-1395-4e6b-bd4e-5488c8abca5f","hostname":"5b17902c8914"},"ecs":{"version":"1.0.0"}}
成功!