python漏洞扫描器爬虫_Python系列之——漏洞平台厂商列表爬虫

作者:奶权

大牛们请跳过哈我相信看这篇文章的 有绝大一部分都玩漏洞平台吧

大部分人挖洞都是去漏洞平台的厂商列表找目标 然后放进扫描器各种扫

但是一个个将厂商的站点复制出来就太麻烦了

于是爬虫在这个时候又起了作用了

以漏洞银行为例子

我们先来分析一下接口

在访问厂商列表的时候有一个Ajax请求

展开来看确实是站点信息

每个索引里面的data数组(json)存放的是站点的信息 status数组(json)中的pause标记了该厂商是否接收漏洞

接下来可以抓包测试看有没有什么限制 带上cookie访问试试

可以看到504了

说明可能有防csrf

再继续看看头部有没有什么东西

看到了一个可疑的authorization头

放进curl看看

成功访问(乱码是因为cmd窗口字符集的问题)

接下来就可以写脚本啦

首先导入用于请求的resquests库和解析json的json库

import requests

import json

定义一个http头的字典

http_header = {

'Host':'www.bugbank.cn',

'x-client-id': 'user-web',

'X-Requested-With': 'XMLHttpRequest',

'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.2564.116 UBrowser/5.6.14087.908 Safari/537.36',

'authorization':'',

#上文提到的Token

'Connection': 'close'

}

一个用于写入文件的函数

def output2File(arr):

try:

f = open('list.txt','a')

for line in arr:

f.write(line + '\n')

finally:

f.close()

主循环编写

先在循环外面定义一个用于标记当前页的flag

接着把循环写死 访问接口并把json解析成Python可读的字典格式

pNum = 1

while 1:

url = "http://www.bugbank.cn/api/companies/upshelf?event=0&page=%s"%pNum

r = requests.get(url,headers=http_header)

data_ = json.loads(r.text)

接着遍历字典 传给写文件函数 再让页数加1后继续循环

while 1:

url = "http://www.bugbank.cn/api/companies/upshelf?event=0&page=%s"%pNum

r = requests.get(url,headers=http_header)

data_ = json.loads(r.text)

websiteArr = []

for websiteInfo in data_['data']:

if websiteInfo['status']['pause'] == 1:

continue

website = websiteInfo['data']['website']

if 'http' not in website:

website = 'http://' + website

print website

websiteArr.append(website)

output2File(websiteArr)

pNum = pNum + 1

加上一些条件判断和异常处理后

while 1:

url = "http://www.bugbank.cn/api/companies/upshelf?event=0&page=%s"%pNum

try:

r = requests.get(url,headers=http_header)

except:

print 'craw%dfail'%pNum

continue

data_ = json.loads(r.text)

websiteArr = []

for websiteInfo in data_['data']:

if websiteInfo['status']['pause'] == 1:

continue

website = websiteInfo['data']['website']

if 'http' not in website:

website = 'http://' + website

print website

websiteArr.append(website)

output2File(websiteArr)

pNum = pNum + 1

if data_['page']['p'] == data_['page']['totalp']:

break

完整代码

#!/usr/bin/env python

# coding:utf-8

import requests

import json

http_header = {

'Host':'www.bugbank.cn',

'x-client-id': 'user-web',

'X-Requested-With': 'XMLHttpRequest',

'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.2564.116 UBrowser/5.6.14087.908 Safari/537.36',

'authorization':'',#上文提到的Token

'Connection': 'close'

}

pNum = 1

def output2File(arr):

try:

f = open('list.txt','a')

for line in arr:

f.write(line + '\n')

finally:

f.close()

while 1:

url = "http://www.bugbank.cn/api/companies/upshelf?event=0&page=%s"%pNum

try:

r = requests.get(url,headers=http_header)

except:

print 'craw%dfail'%pNum

continue

data_ = json.loads(r.text)

websiteArr = []

for websiteInfo in data_['data']:

if websiteInfo['status']['pause'] == 1:

continue

website = websiteInfo['data']['website']

if 'http' not in website:

website = 'http://' + website

print website

websiteArr.append(website)

output2File(websiteArr)

pNum = pNum + 1

if data_['page']['p'] == data_['page']['totalp']:

break

运行结果

到这后就可以把站点丢进一些轻量级或重量级的扫描器中去了

说不定一觉醒来就多了几个洞了哈哈哈哈哈

附：漏洞银行厂商列表

http://www.shihuo.cn

http://www.hupu.com

http://life.cntaiping.com

http://www.luoanziben.com

http://www.biggeryun.com

http://www.1haitao.com

http://www.zhaogang.com

http://www.ekservice.cn

https://www.fangcloud.com

https://www.ys7.com

http://www.ocj.com.cn

http://www.51jiecai.com

http://www.live800.com

http://www.taohv.cn

http://sh.lianjia.com

http://www.ruigushop.com

http://www.scyts.com/

http://www.9you.com/

http://www.wifi8.com/

http://www.qixin.com/

http://www.jucaicat.com

https://ulpay.com/

http://www.xiaoxinyong.com

http://www.shanghailife.com.cn

http://www.zendaimoney.com

http://www.citic-cp.com

http://www.okchexian.com

http://www.zhongan.com

http://www.fangbaba.com

http://www.fuyph.com/

https://www.guojinbao.com

http://www.ips.com

http://www.laowaijia.com

http://www.guanaitong.com

http://www.atzuche.com

http://www.onstar.com.cn

http://www.liulishuo.com

http://www.95579.com

http://www.ubisoft.com.cn

http://www.aoshitang.com

http://www.postbuy.com.cn

http://www.shanghaipower.com

http://www.ec.sgcc.com.cn

http://www.sast.cn

http://www.eshimin.com

http://www.sheca.com

http://www.hshfy.sh.cn

http://www.banbank.com

http://www.quanmin.tv

http://www.dalegames.com

http://www.qyuedai.com

https://www.weiclicai.com

http://www.kjt.com

http://www.bugbank.cn

http://www.cxfund.com.cn

https://www.bawo.cn

http://www.yangmeilc.com

http://www.yocajr.com

http://www.58yicai.com

http://www.hengjin100.com

http://www.midaijihua.com

http://www.baidaifunding.com

http://www.yidaizx.com

http://www.abse.com.cn

http://www.zhengwudai.com

http://www.hsbank360.com

http://haomaiyi.com

http://www.newegg.cn

https://weichouji.sina.com

https://www.wexmarket.com

www.snh48.com/;http://shop.48.cn

https://www.happyfi.com

http://mu.zhaouc.com

http://www.meitun.com

http://www.zhongbaodai.com

http://www.fengchubao.com

http://www.eastlending.com

http://www.juzibank.com

http://www.lvmama.com

http://cn.unionpay.com

http://www.998fund.com

http://yzmoney.com

http://www.card360.com.cn

http://www.thedream.cc

http://www.freexf.com

http://www.5173.com

http://www.marykay.com.cn

http://www.cnelc.com

http://www.shafa.com

http://www.zukelai.com

http://www.lovo.cn

http://www.51bi.com

http://www.7po.com

http://www.renqidai.cc

http://www.7fgame.com

http://www.lufax.com

http://www.jia.com

http://www.i-niuwa.com

http://www.dangdang.com

http://www.360taihe.com

https://www.taironglc.com

http://www.alading.com

http://www.shfuding.com

http://www.imaitu.com

http://www.taosteel.com

http://www.emaiauto.com

http://www.mina.com.cn

http://www.muzhimao.com

http://www.ouyeelf.com

http://www.baogaitou.net

http://www.dfjr580.com

http://www.qidijin.com

http://www.xixiyuezi.com

http://www.greenlandfs.com

http://www.ikang.com/corp

http://www.wacai.com

http://www.yshii.com

http://www.kanjian.com

http://free2ask.cn

http://www.panli.com

http://www.cu-league.com

http://www.pinganfang.com

http://www.outlets365.com

http://dai.hexun.com

http://www.loan163.com

http://www.yaofangwang.com

http://www.eachnet.com

https://www.12345p2p.com

http://www.xgzxian.com

http://www.zhenlicai.cn

http://www.rrdai.com

http://www.fengtouwang.com

http://www.91als.com

http://www.trfans.com

https://www.qizidai.com

http://www.credithc.com

http://www.dtd365.com

http://www.banggo.com

http://www.iyaya.com

http://www.gangker.com

http://www.imobpay.com

http://www.golinksworld.com

http://waimaichaoren.com

http://sh.iyaya.com

https://www.vcredit.com

http://liwoba.com

http://www.aihuishou.com

http://www.59store.com

http://www.qiandw.com

http://www.cmewindow.com

http://www.uecare.cn

http://meichai.in

http://www.ihuanshan.com

https://www.gkewang.com

http://www.datayes.com

http://www.uqee.com

http://www.yztz.com

http://note.sdo.com

http://www.rwxlicai.com

http://www.suicunsuiqu.com

https://www.qiandouw.com

https://www.lingyongdai.com

http://www.holyblade.com

http://www.maizijf.com

http://www.suinihua.com/index.html

http://www.totrade.cn

http://www.bianchushen.com

http://www.wisdom-shield.com

http://www.ysg.cn

http://www.nuozhengtong.com

http://www.rongjiayidai.com

http://www.liguolicai.com

http://www.hyq2048.com

http://www.71dai.com

http://www.zhongwucaifu.com

http://www.woowoodai.com

http://www.olabao.com

http://www.91tianmi.com

http://www.jyssh.com

http://www.ddzhongguo.com

http://www.5aitou.com

http://www.boqii.com

http://www.fenfenriji.com

http://www.tuhu.cn

http://www.ajmide.com

http://www.takead.com.cn

http://www.vipcai.com

https://www.xihappy.com

https://e.ebscn.com

http://www.51p2b.com

http://www.51idc.com

http://www.yifanlc.com

http://www.qianmama.com

http://www.hongshu.com

http://www.stockstar.com

http://www.qidian.com

http://www.youjuke.com

http://www.qiujieda.com

http://www.pinduoduo.com

http://www.haohan360.tv

http://www.cga.com.cn

http://www.zibangcaifu.com

https://www.ucloud.cn

http://www.yangche.com.cn

https://www.vfnetwork.cn

https://www.teambition.com

http://www.51auto.com

https://www.lingtouniao.com

http://www.aba-f.com

http://www.dotour.cn

http://www.gongtoubang.com

http://www.zhiizhii.com

http://www.justing.com

http://www.pingan.com

http://www.hongxinbao.com

http://www.021hjjr.com

http://www.zhifu360.com

http://www.kuaikuaidai.com

http://www.chaoaicai.com

http://www.xueshandai.com

http://www.zxcfchina.com

http://www.mannyi.com

http://www.huarongdao.com

http://www.ygdai.com

http://www.swdai.com

http://www.chinaqtd.com

http://www.lordabbettchina.com

http://www.ttpai.cn

http://www.tiantianchedai.com

http://www.kxb365.com

http://www.metang520.com

http://www.thepaper.cn

http://www.fastcnt.com

http://www.easeeyes.com

http://www.huomaotv.cn

http://www.anyoutian.com

http://www.yicheyanghu.com

https://www.jianguoyun.com

http://www.lechebang.com

http://www.ltshd.com

http://www.bigins.cn

http://www.yododo.com

http://www.mashanglc.com

http://www.traderwork.com

http://www.tophold.com

http://izixin.cn

http://www.xieche.com.cn

http://www.shanggame.com

http://www.baojinsuo.com

http://www.cwan.com

http://ecoshion.cn

http://www.hurongclub.com

http://www.xinyidiandian.com

http://www.byxgame.com

http://www.shengyouxi.com

http://cn.dealglobe.com

http://www.quanshi.com

http://www.zhenai.com

http://www.chinacache.com

http://www.chinanetcenter.com

http://www.guahao.com

http://www.mktkey.com

http://www.made-in-china.com

http://www.fang.com

http://www.muji.com.cn

http://www.zara.cn

http://www2.hm.com/zh_cn/index.html

http://www.mplife.com

http://www.mkf.com

http://www.wdzj.com

http://ichuanyi.com/pc

http://www.xr58.com

http://www.migang.com

http://www.1caifu.com

http://www.51sheng.cn

http://www.jianshu.com

http://www.panda.tv

http://www.ydtz2526.com

http://www.jindashi.cn

https://www.bmqb.com

http://www.kuaigou.co

https://www.mmtvip.com

http://www.igoxin.com

http://www.lifevc.com

http://www.midasjr.com

http://www.51zhengxin.com

http://www.loyalwm.com

http://www.gongziqianbao.com

http://www.trust-one.com

http://m.fuqian.la

http://www.chaojiaoyi.com

http://www.fangrs.com

https://www.okcoin.cn

http://www.51uban.com

http://www.wuxishangyouhui.com

http://www.paaaaa.com

http://www.sanbula.com

http://www.hrgame.com.cn

http://www.miaoguanjia.cn

http://www.ziwow.com

http://www.licaiwu.com

http://www.dianjinsuo.com

http://www.91wutong.com

http://xingren.com

http://www.madailicai.com

http://www.howbuy.com

http://www.chuxindai.com

http://mobanker.com/

http://www.chinatopcredit.com/

http://www.dodomoney.com

http://www.caiyunbank.com

http://www.mingyian.com

http://www.damai.cn

http://www.qiniu.com

https://www.citibank.com.cn

http://www.xzsec.com

http://www.ajzq.com

http://www.longone.com.cn

http://www.cfsc.com.cn

http://www.gtjazg.com

http://www.962518.com

http://www.xyzq.com.cn

http://www.glsc.com.cn

http://www.sundns.com

http://www.wzdai.com

http://www.bangnongdai.cn

http://www.tzw.com

http://www.xiaomd.com

http://www.yijiedai.com

http://www.igeak.com

http://www.shiseapp.com

http://www.111.com.cn

http://www.shaonianxing.org

http://www.longwanct.com

http://app.duangduangauto.com

http://www.jiaoxuebang.com

http://www.ehdai.com

https://shouqianba.com/

http://www.imxingzhe.com

http://www.mentorbridge.cn

http://www.liba.com

http://www.xiaogouqianqian.com

http://www.verycd.com

http://www.bilibili.com

http://www.pchome.net

http://www.tousha8.com

http://cn.strawberrynet.com

http://www.renfenqi.com

http://www.wuyintong.com

http://www.csyeye.com

http://yx.dreamore.com

http://www.ksudi.com

http://www.dfsjr.com

http://www.haoinvest.com

http://www.gbp2g.com

http://www.yuelongcf.com

http://www.dylc.com

http://www.jubao51.com

http://www.vfunding.cn

http://www.qianshengqian.com

http://www.51offer.com

http://www.bingdian.com

http://www.liyuu.com

http://www.88.com

http://www.neitui.me

http://www.ggjr.net

http://www.fangjia.com

https://www.zhuantouwang.com

http://www.huanleren.com

http://www.yidianling.com

http://www.ebscn.com

http://www.epf.com.cn

http://www.xyfunds.com.cn

http://www.51jindu.com

http://www.goshowyou.com/

http://www.morningwhistle.com

http://51zhaoyou.com

http://rongbaike.com/

http://www.haymakergame.com/

http://www.fineex.com

http://www.ganfund.com

http://www.youyiche.com/

http://www.wkzf.com

http://www.aidaijia.com

http://www.qingju.com

http://www.yeetou.com

http://happyaa.com

http://www.cooee.cn

http://www.shenmajr.com

http://www.qcguohu.com/

http://www.fanxiangds.com

http://www.eyugame.com

http://www.andpay.me

http://jiagouyun.com/

http://www.enjoykeys.com

http://www.keede.com

http://www.time2plato.com

http://www.yungoal.com

http://www.miliyo.com

http://www.imifun.com/

http://www.9niu.com

http://jidongnet.com

http://www.17law.cn

http://www.youdemai.com

http://www.larahits.com

http://www.bullbill.com

http://www.51wmt.com

http://www.fuiou.com

http://www.badazhou.com

http://www.cnhbstock.com

http://www.youlunlx.com

http://www.xinshipu.com

http://www.mu77.com

https://www.weicaifu.com

http://www.jhrobot.com

http://www.wealink.com

http://www.elong.com

http://www.moseeker.com/

http://www.wenjuan.com

http://www.iwgame.com

http://www.weimob.com

http://www.shanghaiairport.com

http://www.51mokao.com

https://www.xiaojinlicai.com/

http://www.ups.com

http://www.yingle.com

http://www.tebon.com.cn

http://www.tnt.com

http://www.hffunds.cn

http://c.ycgame.com/

http://www.cashbus.com/

http://www.98.cn

http://www.shengjinsuo.com

http://www.ce9.com

http://www.ickey.cn/

http://www.cndw.com

http://www.baofoo.com

http://www.xtwealth.com

http://www.huizuche.com

http://www.xiaotaojiang.com

https://www.shfft.com

https://www.decathlon.com.cn

http://www.fancyedu.net/

http://www.gtjaqh.com

http://www.huazhu.com

http://www.ebfcn.com

http://www.donghaifunds.com

http://www.xyamc.com

http://www.chinanature.com.cn

http://www.laicaijie.com

http://www.boohee.com

http://www.bolo.me

http://www.rongyu100.com

http://www.pptv.com

http://www.utan.com

http://www.daoxila.com

http://www.jinjiang.com

http://www.yirendai.com

http://www.chinalife.com.cn

http://www.spdb.com.cn

http://www.ceibs.edu

http://www.easipay.net

http://www.xd.com

http://www.joy.cn

http://www.crownewplaza.com

http://www.k-boxing.com

http://www.kingnet.com

http://www.4008123123.com

http://www.4008823823.com.cn

http://www.shrbank.com

http://www.dfzq.com.cn

http://www.lefeng.com

http://game.51.com

http://www.boscam.com.cn

https://etrade.gtfund.com

http://www.sinochemintl.com

http://www.bocifco.com

http://www.qigehulu.com

http://www.tcpjw.com

http://www.etongdai.com

http://www.yinpiao.com

http://www.shitou.com

http://www.p2pchina.com

http://www.chenengdai.com

http://www.pkufi.com

http://www.springtour.com

http://www.ch.com

http://www.9fbank.com

http://www.tiancity.com

http://www.guodu.cc

http://www.jiuxian.com

http://www.shandagames.com

http://www.suning.com

http://www.bocichina.com

http://www.allinpay.com

http://www.juneyaoair.com

http://www.htsec.com

http://www.ect888.com

http://www.niwodai.com

http://www.dianrong.com

http://www.gewara.com

http://www.zhendui999.com

http://club.shopex.cn

http://www.sinosig.com

http://www.game-reign.com

http://www.99bill.com

http://www.yesmywine.com

http://www.dhqjr.com

http://www.sto.cn

http://www.weaver.com.cn

http://www.galaxyasset.com

http://www.ule.com

http://www.51.com

http://sh.tedu.cn

http://www.baixing.com

http://www.sh.sgcc.com.cn

http://www.anjuke.com

http://www.chexiang.com

http://www.hkbea.com.cn

http://www.fund001.com

http://www.rong360.com

http://www.u51.com

http://www.ymatou.com

http://www.xiaohongshu.com

http://www.tuniu.com

http://www.yiguo.com

http://www.zbird.com

http://www.gtja.com

http://www.mbaobao.com

http://www.meilishuo.com

http://www.mogujie.com

http://www.sywgqh.com.cn

http://www.jumei.com

http://www.longtugame.com

http://xueqiu.com

http://www.iqiyi.com

http://www.fangdd.com

http://www.gangtaikonggu.com.cn

http://www.hongdoulicai.com

http://www.koudailc.com

http://www.dajie.com

http://www.to8to.com

http://www.feiniu.com

http://www.reebonz.cn

http://www.hujiang.com

http://www.dianping.com

http://www.51job.com

http://www.fanli.com

http://www.bl.com

http://www.firstp2p.com

http://www.pccb.com

http://www.nonobank.com

http://www.gujinsuo.com.cn/index.html

http://www.83chedai.com

http://www.yonglibao.com

http://www.lovelinks.com.cn

http://www.citicprufunds.com.cn本文禁止任何形式转载 知乎官方除外