Flume 安装部署文档

1. 从官网 http://flume.apache.org/download.html 下载apache-flume-1.9.0-bin.tar.gz
2. 解压缩：tar -zxvf /opt/apache-flume-1.9.0-bin.tar.gz -C /usr/local/
3. 把conf目录下的flume-env.sh. template重命名为 flume-env.sh 并修改此配置文件, JAVA_HOME变量设置
export JAVA_HOME=/usr/java/jdk1.8.0_281-amd64
Flume1.9要求JDK1.8或以上
4.在/etc/profile配置环境变量
#FLUME_HOME
export FLUME_HOME=/usr/local/apache-flume-1.9.0-bin
export PATH=$PATH:$FLUME_HOME/bin
5. 验证是否安装成功：flume-ng version
[root@master conf]# flume-ng version
Error: Could not find or load main class org.apache.flume.tools.GetJavaProperty
Flume 1.9.0
Source code repository: https://git-wip-us.apache.org/repos/asf/flume.git
Revision: d4fcab4f501d41597bc616921329a4339f73585e
Compiled by fszabo on Mon Dec 17 20:45:25 CET 2018
From source with checksum 35db629a3bda49d23e9b3690c80737f9

 

解决Error:
vim /usr/local/apache-flume-1.9.0-bin/bin/flume-ng
在110行 添加如下内容：
2>/dev/null | grep hbase（添加这一行）

if [ -f "${HBASE_IN_PATH}" ]; then
    info "Including HBASE libraries found via ($HBASE_IN_PATH) for HBASE access"

    # determine HBASE java.library.path and use that for flume
    local HBASE_CLASSPATH=""
    local HBASE_JAVA_LIBRARY_PATH=$(HBASE_CLASSPATH="$FLUME_CLASSPATH" \
        ${HBASE_IN_PATH} org.apache.flume.tools.GetJavaProperty \
        java.library.path 2>/dev/null | grep hbase)

    # look for the line that has the desired property value
    # (considering extraneous output from some GC options that write to stdout)
    # IFS = InternalFieldSeparator (set to recognize only newline char as delimiter)