flume + elasticsearch

 

flume + elasticsearch

flume-1.9.0 + elasticsearch-7.7.1 + kibana-7.7.1

不是在采坑就是在采坑的路上！！！

下载地址

flume-ng  

http://flume.apache.org/download.html

elasticsearch  

https://www.elastic.co/cn/downloads/past-releases#elasticsearch

kibana        

https://www.elastic.co/cn/downloads/past-releases/kibana-7-7-1

 

默认flume支持0.x 1.x的elasticsearch
如使用高版本的elasticsearch 需要修改

The elasticsearch and lucene-core jars required for your environment must be placed in the lib directory of the Apache Flume installation. Elasticsearch requires that the major version of the client JAR match that of the server and that both are running the same minor version of the JVM. SerializationExceptions will appear if this is incorrect. To select the required version first determine the version of elasticsearch and the JVM version the target cluster is running. Then select an elasticsearch client library which matches the major version. A 0.19.x client can talk to a 0.19.x cluster; 0.20.x can talk to 0.20.x and 0.90.x can talk to 0.90.x. Once the elasticsearch version has been determined then read the pom.xml file to determine the correct lucene-core JAR version to use. The Flume agent which is run