做EFK日志收集的时候会用到,解析python程序的apache服务器产生的日志,java相关的请移步看我另一篇文章
包含两种常见的形式和一种自定义形式
第一种,python的error.log形式
[Wed Jul 07 07:10:24.917274 2021] [wsgi:error] [pid 8] [remote 192.168.5.75:52770] /usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py:1020: InsecureRequestWarning: Unverified HTTPS request is being made to host '172.20.140.242'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings
第二种,python的info.log形式
10.244.0.0 - - [07/Jul/2021:02:30:56 +0000] "GET / HTTP/1.1" 405 187
time_format为 time_format %d/%b/%Y:%H:%M:%S %z
如果使用fluentd收集的话,可以直接使用
time_format %d/%b/%Y:%H:%M:%S %z
<parse>
@type apache2
</parse>
第三种,自定义的形式
[Wed Jul 07 07:10:24.917274 2021] [wsgi:error] [pid 8] [remote 192.168.5.75:52770] /usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py:1020: InsecureRequestWarning: Unverified HTTPS request is being made to host '172.20.140.242'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings
上述用到的所有表达式点击此处下载,都是自己纯手写研究出来的,不支持白嫖,如果还有什么问题请直接私信,能帮的尽量帮忙,感激不尽。