通过nginx access.log统计接口访问量

背景：统计近期rest接口访问情况

1、查看包含关键字xxx的http请求

 cd ~/nginx/logs 

gzip -d access.log-20180611.gz

grep xxx access.log-20180611 

100.116.219.230 - - [11/Jun/2018:01:21:45 +0800] "POST /api/v3/free/xxxx.json HTTP/1.1" 200 17747 "http://xxx.finance/common/senioption?app=xxx&ver=x" "Mozilla/5.0 (Linux; Android 6.0.1; OPPO R9s Build/MMB29M; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/55.0.2883.91 Mobile Safari/537.36 AppName/xxx AppBuild/205 AppVersion/4.3.0 Jockey/true" "10.10.10.10"

目标是要统计出/api/v3/free/xxxx.json 个数

2、统计20180611 ～20180617号（分别对应7个log文件）之间的http接口访问量,  创建count.sh：

#!/bin/bash
for i in {1..7}
do
    grep -i xxxx access.log-2018061${i} | awk -F '"' '{print $2}' | awk -F ' ' '{print $2}' | awk -F '?' '{print $1}' | awk -F '-' '{a[$1]++}END{for(i in a){print i,a[i]}}' | sort -k 2 -hr 

done

这里用到一个数组的概念

运行结果：/loanApi/free/company/getDetilCitylist.json 6
/loanApi/free/calculator/showInterest.json 25
/loanApi/free/company/getDetilCitylist.json 13

/api/v3/fed/initOrder.json 1  ……

3、汇总

awk '{s[$1] += $2}END{ for(i in s){  print i, s[i] } }'

2与3合并为一步就是：

./count.sh | awk '{s[$1] += $2}END{ for(i in s){  print i, s[i] } }'