安装filebeat
linux安装filebeat采集consul日志,并发送到kafka
1. 创建安装目录
mkdir -p /opt/server
mkdir -p /data/logs
2. 下载安装包并解压
tar -zxvf filebeat-6.3.1-linux-x86_64.tar.gz
3. 重命名文件夹为filebeat
mv filebeat-6.3.1-linux-x86_64 filebeat
4. 修改配置文件filebeat.yml
cd filebeat
vim filebeat.yml
logging.level: info
logging.to_files: true
logging.files:
path: /var/log/filebeat
name: filebeat
keepfiles: 7
permissions: 0644
filebeat.inputs:
- type: log
enabled: true
fields:
log-type: consul
paths:
- /data/logs/*.log
output.kafka:
hosts: ["kafka1:9092", "kafka2:9092", "kafka3:9092"]
topic: 'logs'
partition.hash:
reachable_only: false
required_acks: 1
compression: gzip
max_message_bytes: 1000000
5. 配置kafka服务器host
172.16.10.213 kafka1
172.16.10.214 kafka2
172.16.10.218 kafka3
6. 启动filebeat
nohup ./filebeat -c filebeat.yml >> /dev/null 2>&1 &