Flume官网地址
文档查看地址
http://flume.apache.org/FlumeUserGuide.html
下载地址
http://archive.apache.org/dist/flume/
安装部署
1.将apache-flume-1.9.0-bin.tar.gz上传到linux的/opt/software目录下
apache-flume-1.9.0-bin.tar.gz
2.解压apache-flume-1.9.0-bin.tar.gz到/opt/server/目录下
[linux@node1 software]$ tar -zxvf apache-flume-1.9.0-bin.tar.gz -C /opt/server/
3.修改apache-flume-1.9.0-bin的名称为flume
[linux@node1 server]$ mv apache-flume-1.9.0-bin/ flume
4.将lib文件夹下的guava-11.0.2.jar删除以兼容Hadoop 3.1.3(避免jar冲突)
[linux@node1 server]$ rm -rf /opt/server/flume/lib/guava-11.0.2.jar
注意:删除guava-11.0.2.jar的服务器节点,一定要配置hadoop环境变量。否则会报如下异常。
Caused by: java.lang.ClassNotFoundException: com.google.common.collect.Lists
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 1 more
5.将flume/conf下的flume-env.sh.template文件修改为flume-env.sh,并配置flume-env.sh文件
[linux@node1 conf]$ mv flume-env.sh.template flume-env.sh
[linux@node1 conf]$ vim flume-env.sh
export JAVA_HOME=/opt/server/jdk1.8.0_212