logstash 安装导入mysql数据至ElasticSearch

0:安装好ElasticSearch

1:然后解压 logstash安装包 unzip  logstash-5.4.0.zip

2:安装logstash-input-jdbc 插件(版本5X以上直接安装，5以下的搞了半天没搞出来直接升级版本了)：  sudo bin/plugin install logstash-input-jdbc

3:新建数据库，并添加增量测试数据CREATE TABLE `city` (
  `id` int(11) unsigned NOT NULL AUTO_INCREMENT,
  `description` varchar(12) DEFAULT NULL,
  `province_id` int(11) DEFAULT NULL,
  `city_name` varchar(12) DEFAULT NULL,
  PRIMARY KEY (`id`)
) ENGINE=InnoDB AUTO_INCREMENT=5 DEFAULT CHARSET=utf8;

4:在logstash config下新建jdbc.conf:

input {
    jdbc {
        jdbc_driver_library =>"/Users/sunwenlong/Downloads/other/es5.4/mysqldriver/mysql-connector-java-5.1.45-bin.jar"
        jdbc_driver_class =>"com.mysql.jdbc.Driver"
        jdbc_connection_string =>"jdbc:mysql://127.0.0.1:3305/springbootdb?characterEncoding=UTF-8&useSSL=false"
        jdbc_user =>"root"
jdbc_password =>"123456"
        #schedule =>"* * * * *"
        #jdbc_default_timezone =>"Asia/Shanghai"
        statement =>"SELECT * FROM city"
    }
}
output {
    elasticsearch {
        index =>"test_city_index"
        document_type =>"test_city_type"
        document_id =>"%{id}"
template_overwrite => true
        hosts =>["127.0.0.1:9200"]
    }
}

5:执行命令启动：./bin/logstash -f ./config/jdbc.conf 即可

6:地址栏访问http://127.0.0.1:9200/test_city_index/test_city_type/1即可查看相关数据

(mysql相关包在下和logstash官网下载即可)