1:编辑相关文件
cd /root/dockerFile
chmod 777 logstash
cd logstash
logstash包括三个文件:Dockerfile,kafkafile1(777权限,数据就是往这个文件写),logstashKafka.conf(logstash的配置文件)
Dockerfile文件内容:
FROM logstash:latest
COPY logstashKafka.conf /usr/local/bin/
CMD ["-f", "/usr/local/bin/logstashKafka.conf"]
logstashKafka.conf文件内容:
input {
kafka {
bootstrap_servers => "10.10.0.102:9092,10.10.0.103:9092,10.10.0.104:9092" #kafka的zk集群地址
group_id => "hdfs" #消费者组,不要和ELK上的消费者一样
client_id => "RFID_ORIGIN"
topics => ["RFID_ORIGIN"] #topic
consumer_threads => 1
#codec => 'json'
type => "RFID_ORIGIN"
}
}
filter {
}
output {
if [type] == "RFID_ORIGIN" {
file {
path => "/lifuyi/kafkafile1"
codec => line { format => "custom format: %{message}"}
#codec => rubydebug
}
}
}
2:新建镜像
在logstash目录下执行,注意最后有个.
sudo docker build -t my-log:latest .
3:运行容器
sudo docker run -it --name mylog -v /root/dockerFile/logstash/:/lifuyi my-log