k8s环境的fluentd:故障处理篇

• mkmf.rb can’t find header files for ruby at /usr/lib/ruby/include/ruby.h
  

# 我用的镜像是 registry.cn-hangzhou.aliyuncs.com/kubeapps/gcr-fluentd-elasticsearch:v2.4.0 
解决办法：
(1)所有的worker上 执行 yum install ruby-devel -y
(2) 挂载服务器的/usr/include/ruby到容器内的/usr/lib/ruby/include 

• 2020-12-30 13:30:12 +0000 [warn]: #0 [kafka-match] failed to flush the buffer. retry_time=1 next_retry_seconds=2020-12-30 13:30:13 +0000 chunk=“5b7ae7de56d6ff043f30b1ef4a735952” error_class=Kafka::MessageSizeTooLarge error=“Kafka::MessageSizeTooLarge”
  

# 命令行
kafka-topics.sh --zookeeper zookeeper-svc:2181  --alter   --topic nginx-nginx --config max.message.bytes=20000000
# 修改配置文件
#broker能接收消息的最大字节数 server.properties
message.max.bytes=20000000