filter grok 判断_ELK中对Tomcat日志的 filter grok match 写法

最新推荐文章于 2021-10-27 15:27:14 发布

青清朝阳

最新推荐文章于 2021-10-27 15:27:14 发布

阅读量228

点赞数

文章标签： filter grok 判断

本文链接：https://blog.csdn.net/weixin_42520374/article/details/111971790

版权

本文介绍了如何在ELK（Elasticsearch, Logstash, Kibana）环境中利用filter和grok匹配技术处理Tomcat日志，特别是针对含有SQL Session信息的日志条目进行有效解析，以便进行更精确的日志分析和监控。" 130642180,10726641,逆序对问题的离散化与树状数组解决方案,"['算法', '数据结构', '排序算法']

摘要由CSDN通过智能技术生成

Tomcat日志

015-09-24 17:32:21 [http-bio-80-exec-7] DEBUG org.mybatis.spring.SqlSessionUtils -Closing non transactional SqlSession [org.apache.ibatis.session.defaults.DefaultSqlSession@1d5907b0]

2015-09-24 17:32:21 [http-bio-80-exec-7] DEBUG org.mybatis.spring.SqlSessionUtils -Creating a new SqlSession

2015-09-24 17:32:21 [http-bio-80-exec-7] DEBUG org.mybatis.spring.SqlSessionUtils -SqlSession [org.apache.ibatis.session.defaults.DefaultSqlSession@4007c2dd] was not registered for synchronization because synchronization is not active

2015-09-24 17:32:21 [http-bio-80-exec-7] DEBUG com.xx.server.mapper.PictureMapper -Cache Hit Ratio [com.xx.server.mapper.PictureMapper]: 0.5483870967741935

2015-09-24 17:32:21 [http-bio-80-exec-7] DEBUG org.mybatis.spring.SqlSessionUtils -Closing non transactional SqlSession [org.apache.ibatis.session.defaults.DefaultSqlSession@4007c2dd]

2015-09-24 17:32:21 [http-bio-80-exec-7] DEBUG org.mybatis.spring.SqlSessionUtils -Creating a new SqlSession

2015-09-24 17:32:21 [http-bio-80-exec-7] DEBUG org.mybatis.spring.SqlSessionUtils -SqlSession [org.apache.ibatis.session.defaults.DefaultSqlSession@3d8a5c02] was not registered for synchronization because synchronization is not active

2015-09-24 17:32:21 [http-bio-80-exec-7] DEBUG com.xx.server.mapper.CommodityPackageMapper -Cache Hit Ratio [com.xx.server.mapper.CommodityPackageMapper]: 0.9473684210526315

2015-09-24 17:32:21 [http-bio-80-exec-7] DEBUG org.mybatis.spring.SqlSessionUtils -Closing non transactional SqlSession [org.apache.ibatis.session.defaults.DefaultSqlSession@3d8a5c02]

2015-09-24 17:32:21 [http-bio-80-exec-7] DEBUG com.xx.server.aspect.LogAspect -{ip:183.15.243.209,url:http://api.xxx.com/server/sc/commodity/getCommodity,param:{"shopId":1110002,"page":0,"limit":20,"needPage":true,"needCategory":true,"keyword":""},return:{"status":1,"data":{"commodityDTO":[{"id":1472238,"shopId":1110002,"categoryId":1466734,"barcode":"6901028182652","name":"黄鹤楼大彩(硬)","price":30.00,"stock":100,"specification":"6mg","unit":"包","picId":1473958,"picPath":"common/commodity/2014/07/17/53c75b5003843.jpg","status":1,"categoryName":"香烟","addType":0},{"id":1474243,"shopId":1110002,"categoryId":1466733,"barcode":"4891599338393","name":"加多宝凉茶","price":4.00,"stock":200,"specification":"310ml","unit":"罐","status":1,"categoryName":"饮料","addType":0},{"id":1474240,"shopId":1110002,"categoryId":1466733,"barcode":"6907992103136","name":"伊利每益添乳酸菌","price":8.00,"stock":100,"specification":"300ml","unit":"瓶","status":1,"categoryName":"饮料","addType":0}],"commodityListSize":3,"total":3,"categoryDTOList":[{"id":0,"name":"全部商品","order":0,"commodityTotal":3},{"id":1466733,"name":"饮料","order":0,"commodityTotal":2},{"id":1466734,"name":"香烟","order":0,"commodityTotal":1},{"id":1467037,"name":"生活用品","order":0,"commodityTotal":0}]}},cost:15.730ms}

想获得如下message

{

"message" => "2015-09-24 18:13:00 [http-bio-80-exec-1] DEBUG com.xx.server.aspect.LogAspect -{ip:183.15.243.209,url:http://api.xxx.com/server/pub/user/login,param:{\"hashKey\":\"\",\"nonce\":\"\",\"account\":\"\",\"pwd\":\"\"},return:{\"status\":0,\"message\":\"HashKey校验失败\"},error:HashKey校验失败}",

"@version" => "1",

"@timestamp" => "2015-09-24T10:13:01.346Z",

"host" => "xx-server-01",

"path" => "/opt/software/apache-tomcat-7.0.59/logs/catalina.out",

"type" => "xx_server_log",

"url" => "http://api.xxx.com/server/sc/commodity/getCommodity",

"param" => "{"shopId":1110002,"page":0,"limit":20,"needPage":true,"needCategory":true,"keyword":""}",

"return" => "{"status":1,"data":{"commodityDTO":[{"id":1472238,"shopId":1110002,"categoryId":1466734,"barcode":"6901028182652","name":"黄鹤楼大彩(硬)","price":30.00,"stock":100,"specification":"6mg","unit":"包","picId":1473958,"picPath":"common/commodity/2014/07/17/53c75b5003843.jpg","status":1,"categoryName":"香烟","addType":0},{"id":1474243,"shopId":1110002,"categoryId":1466733,"barcode":"4891599338393","name":"加多宝凉茶","price":4.00,"stock":200,"specification":"310ml","unit":"罐","status":1,"categoryName":"饮料","addType":0},{"id":1474240,"shopId":1110002,"categoryId":1466733,"barcode":"6907992103136","name":"伊利每益添乳酸菌","price":8.00,"stock":100,"specification":"300ml","unit":"瓶","status":1,"categoryName":"饮料","addType":0}],"commodityListSize":3,"total":3,"categoryDTOList":[{"id":0,"name":"全部商品","order":0,"commodityTotal":3},{"id":1466733,"name":"饮料","order":0,"commodityTotal":2},{"id":1466734,"name":"香烟","order":0,"commodityTotal":1},{"id":1467037,"name":"生活用品","order":0,"commodityTotal":0}]",

"cost" => 15.730,

"ip" => 183.15.243.209,

"address" => 深圳

“status” => 200

]

}

并且过滤掉

015-09-24 17:32:21 [http-bio-80-exec-7] DEBUG org.mybatis.spring.SqlSessionUtils -Closing non transactional SqlSession [org.apache.ibatis.session.defaults.DefaultSqlSession@1d5907b0]

2015-09-24 17:32:21 [http-bio-80-exec-7] DEBUG org.mybatis.spring.SqlSessionUtils -Creating a new SqlSession

以及

错误堆栈信息