搭建ELK(Elasticsearch、logstash、kibana)
准备条件安装JDK 至少为1.8
ELK下载官方网址
https://www.elastic.co/cn/downloads/
国内官网下载太慢可参考网址:
https://blog.nice100.net/download/7.html
Logstash配置
1、Logstash将数据数到mysql,需要安装logstash-output-jdbc 插件,下载地址logstash-output-jdbc,首先进入logstash目录,执行以下命令
bin/logstash-plugin logstash-output-jdbc
2、JDBC依赖”mysql-connector-java-8.0.22”,在官网下载地址
https://dev.mysql.com/downloads/file/?id=498583
3、在目录config下复制一份logstash-sample.conf 改名为logstash.conf并配置如下
input {
kafka {
bootstrap_servers => "127.0.0.1:9092"
topics => ["test"]
codec => "json"
}
}
filter {
if [type] == "test" {
mutate {
}
json {
source => "msg"
}
}
}
output {
if [tags]