logstash数据采集
Logstash安装与配置
软件下载
https://elasticsearch.cn/download/
logstash安装
rpm -ivh jdk-8u171-linux-x64.rpm #安装Java环境
rpm -ivh logstash-7.6.1.rpm
标准输入到标准输出
/usr/share/logstash/bin/logstash -e 'input { stdin { } } output { stdout {} }'
file输出插件
[root@server4 ~]# vim /etc/logstash/conf.d/file.conf
input {
stdin {}
}
output {
file {
path => "/tmp/testfile"
codec => line { format => "custom format: %{message}"}
}
}
指定配置文件运行
[root@server4 ~]# /usr/share/logstash/bin/logstash -f /etc/logstash/conf.d/file.conf
输入
查看输出
elasticsearch输出插件
vim /etc/logstash/conf.d/es.conf
input {
stdin {}
}
output {
elasticsearch {
hosts => "172.25.21.2:9200" #es集群中的一个ip
index => "logstash-%{+YYYY.MM.dd}"
}
}
指定配置文件运行
/usr/share/logstash/bin/logstash -f /etc/logstash/conf.d/es.conf
输入
hello es
hello
查看输出
file插件配合elasticsearch输出插件
chmod 644 /var/log/messages 首先先有文件的读权限
vim /etc/logstash/conf.d/es.c