logstash 7.10安装

最新推荐文章于 2024-06-09 00:34:08 发布

不正经运维君

最新推荐文章于 2024-06-09 00:34:08 发布

阅读量710

点赞数

分类专栏： logstash

本文链接：https://blog.csdn.net/qq_21442867/article/details/115628901

版权

logstash 专栏收录该内容

1 篇文章 0 订阅

订阅专栏

文章目录

1 系统初始化
2 下载安装包
3 安装logstash
4 调试命令

1 系统初始化

系统版本： CentOS 7.6

sed -i 's/enforcing/disabled/g'  /etc/selinux/config
setenforce 0
sed -i 's/#UseDNS yes/UseDNS no/g'   /etc/ssh/sshd_config
systemctl   restart sshd
grep DNS               /etc/ssh/sshd_config
grep SELINUX=disabled  /etc/selinux/config 
systemctl  disable firewalld  NetworkManager
systemctl  stop    firewalld    NetworkManager

2 下载安装包

wget  https://artifacts.elastic.co/downloads/logstash/logstash-7.10.0-x86_64.rpm  -P /opt/

3 安装logstash

yum -y install /opt/logstash-7.10.0-x86_64.rpm

4 调试命令

/usr/share/logstash/bin/logstash  -e 'input{stdin{}}output{stdout{codec=>rubydebug}}'

文件输入

/usr/share/logstash/bin/logstash  -e 'input{file{path => ["/var/log/boot.log","/var/log/message"]}}output{stdout{codec=>rubydebug}}'

文件开始处输入方便调试

/usr/share/logstash/bin/logstash  -e 'input{file{path => ["/var/log/messages","/var/log/secure"] start_position => "beginning" sincedb_path => "/dev/null"}}output{stdout{codec=>rubydebug}}'

/usr/share/logstash/bin/logstash  -e 'input{stdin{}}output{elasticsearch{hosts=>["192.168.3.13:9200"]}}'

同时输出到stdout 和 es

/usr/share/logstash/bin/logstash  -e 'input{stdin{}}output{stdout{codec=>rubydebug}elasticsearch{hosts=>["192.168.3.13:9200"]}}'

kafka 输入输出到stdout 和 es

/usr/share/logstash/bin/logstash  -e 'input{kafka{bootstrap_servers => "192.168.3.13:9092" topics => "quickstart-events" }}output{stdout{codec=>rubydebug}elasticsearch{hosts=>["192.168.3.13:9200"]}}'

input kafka output 认证es

/usr/share/logstash/bin/logstash  -e 'input{kafka{bootstrap_servers => "192.168.3.13:9092" topics => "quickstart-events" }}output{stdout{codec=>rubydebug}elasticsearch{hosts=>["192.168.3.13:9200"] user=>elastic password=>iv57ZpA2DvuDAqA6smJr}}'

指定group_id

/usr/share/logstash/bin/logstash  -e 'input{kafka{bootstrap_servers => "192.168.3.13:9092" topics => "quickstart-events" group_id => test}}output{stdout{codec=>rubydebug}elasticsearch{hosts=>["192.168.3.13:9200"] user=>elastic password=>iv57ZpA2DvuDAqA6smJr}}'

发送到带有密码认证的es

/usr/share/logstash/bin/logstash  -e 'input{stdin{}}output{stdout{codec=>rubydebug}elasticsearch{hosts=>["192.168.3.13:9200"] user=>elastic password=>iv57ZpA2DvuDAqA6smJr}}'

/usr/share/logstash/bin/logstash  -e 'input{kafka{bootstrap_servers => "192.168.3.13:9092" topics => "quickstart-events" }}output{stdout{codec=>rubydebug}elasticsearch{hosts=>["192.168.3.13:9200"] user=>elastic password=>iv57ZpA2DvuDAqA6smJr}}'