logstash-7.13.0 安装部署

前提准备

序号	软件
1	jdk-8u192-linux-x64.rpm
2	logstash-7.13.0-linux-x86_64.tar.gz

安装说明

内容	描述
服务器IP	192.168.16.128
安装位置	/usr/local/logstash
conf文件	/usr/local/logstash/conf.d
setting文件	/usr/local/logstash/config

安装步骤

安装JDK

$ rpm -ivh jdk-8u192-linux-x64.rpm

$ java -version

# 配置环境变量
$ vim /etc/profile
export JAVA_HOME=/usr/java/jdk1.8.0_192-amd64
export JRE_HOME=$JAVA_HOME/jre
export PATH=$PATH:$JAVA_HOME/bin:$JRE_HOME/bin;
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar:$JRE_HOME/lib

$ source /etc/profile

解压

$ tar -zxvf logstash-7.13.0-linux-x86_64.tar.gz

$ mv logstash-7.13.0 /usr/local/logstash

修改启动参数

# 创建配置文件存放目录
$ mkdir /usr/local/logstash/conf.d

$ vim /usr/local/logstash/config/startup.options
# 添加或修改以下参数
JAVA_HOME=/usr/java/jdk1.8.0_192-amd64
LS_HOME=/usr/local/logstash
LS_SETTINGS_DIR=/usr/local/logstash/config
LS_OPTS="--path.settings ${LS_SETTINGS_DIR} --path.config /usr/local/logstash/conf.d"

拷贝文件

cp -ar /usr/local/logstash/config/logstash-sample.conf /usr/local/logstash/conf.d/logstash-test.conf

创建服务

# 先创建组和用户
$ groupadd logstash

$ useradd -M -s /sbin/nologin -g logstash logstash

# 创建服务及文件
$ sh /usr/local/logstash/bin/system-install

执行命令后，会生成两个文件。

1. 环境变量文件

   $ cat /etc/default/logstash
   
   JAVA_HOME="/usr/java/jdk1.8.0_192-amd64"
   LS_HOME="/usr/local/logstash"
   LS_SETTINGS_DIR="/usr/local/logstash/config"
   LS_PIDFILE="/var/run/logstash.pid"
   LS_USER="logstash"
   LS_GROUP="logstash"
   LS_GC_LOG_FILE="/var/log/logstash/gc.log"
   LS_OPEN_FILES="16384"
   LS_NICE="19"
   SERVICE_NAME="logstash"
   SERVICE_DESCRIPTION="logstash"
   

2. 服务文件

   $ cat /etc/systemd/system/logstash.service
   
   [Unit]
   Description=logstash
   
   [Service]
   Type=simple
   User=logstash
   Group=logstash
   EnvironmentFile=-/etc/default/logstash
   EnvironmentFile=-/etc/sysconfig/logstash
   # 添加参数--config.reload.automatic来实现配置文件自动加载
   ExecStart=/usr/local/logstash/bin/logstash "--config.reload.automatic" "--path.settings" "/usr/local/logstash/config" "--path.config" "/usr/local/logstash/conf.d"
   Restart=always
   WorkingDirectory=/
   Nice=19
   LimitNOFILE=16384
   
   TimeoutStopSec=infinity
   
   [Install]
   WantedBy=multi-user.target
   
   $ systemctl daemon-reload
   

服务启停

$ systemctl start logstash
$ systemctl stop logstash
$ systemctl status logstash
$ systemctl enable logstash

测试

1. 创建测试文件

$ vim /usr/local/logstash/test/test01.log

May 19 10:41:33 aaa 000000000000000000000000
May 19 10:41:33 aaa 000000000000000000000000
May 19 10:41:33 aaa 000000000000000000000000
May 19 10:41:33 aaa 000000000000000000000000

2. 修改测试配置文件

$ vim /usr/local/logstash/conf.d/logstash-test.conf

input{
    file{
        path =>"/usr/local/logstash/test/test01.log"
        start_position=>"beginning"
    }
}
 
filter{

}
 
output{
    stdout{
        codec=>rubydebug
    }
}