0:安装好ElasticSearch
1:然后解压 logstash安装包 unzip logstash-5.4.0.zip
2:安装logstash-input-jdbc 插件(版本5X以上直接安装,5以下的搞了半天没搞出来直接升级版本了): sudo bin/plugin install logstash-input-jdbc
3:新建数据库,并添加增量测试数据CREATE TABLE `city` (
`id` int(11) unsigned NOT NULL AUTO_INCREMENT,
`description` varchar(12) DEFAULT NULL,
`province_id` int(11) DEFAULT NULL,
`city_name` varchar(12) DEFAULT NULL,
PRIMARY KEY (`id`)
) ENGINE=InnoDB AUTO_INCREMENT=5 DEFAULT CHARSET=utf8;
4:在logstash config下新建jdbc.conf:
input {
jdbc {
jdbc_driver_library =>"/Users/sunwenlong/Downloads/other/es5.4/mysqldriver/mysql-connector-java-5.1.45-bin.jar"
jdbc_driver_class =>"com.mysql.jdbc.Driver"
jdbc_connection_string =>"jdbc:mysql://127.0.0.1:3305/springbootdb?characterEncoding=UTF-8&useSSL=false"
jdbc_user =>"root"
jdbc_password =>"123456"
#schedule =>"* * * * *"
#jdbc_default_timezone =>"Asia/Shanghai"
statement =>"SELECT * FROM city"
}
}
output {
elasticsearch {
index =>"test_city_index"
document_type =>"test_city_type"
document_id =>"%{id}"
template_overwrite => true
hosts =>["127.0.0.1:9200"]
}
}
5:执行命令启动:./bin/logstash -f ./config/jdbc.conf 即可
6:地址栏访问http://127.0.0.1:9200/test_city_index/test_city_type/1即可查看相关数据
(mysql相关包在下和logstash官网下载即可)