python爬虫表单总结

本文探讨了使用Python爬虫处理表单数据的问题,通过分析请求连接和响应数据,发现动态数据对获取正确信息的重要性。在尝试过程中,通过筛选和添加网站JSON数据,最终成功获取所需信息。同时提到了Cookie在爬虫访问过程中的作用,指出了在某些情况下关闭或添加Cookie可能影响页面访问的成功与否。
摘要由CSDN通过智能技术生成

动态内容,ajax的数据在XHR里面,刷新可以查看新抓的包里面有没有自己想要的数据。

  1. IF-TargetVerb:
    POST
  2. IF-TargetContent:
    [{"Lbl":"attachmentWrapper","Src":"div.InFlightAttachment:first","Data":"null","HWA":".","Children":[{"Lbl":"attachmentLink","Src":".","Data":"text:href","Children":[]}]},{"Lbl":"popupMessageContent","Src":"span.InFlightPopup","Data":"html","Children":[]},{"Lbl":"item2","Src":"[id=ZZ_VNDR_AD_WRK_DESCR2000]","Data":"value","Children":[]},{"Lbl":"acceptInvite","Src":"#RESP_INQ_DL0_WK_BID_INV_ACCPT_BTN","Data":"id name","HWA":".","Children":[]},{"Lbl":"if_error_items","Src":"div[id*=RESP_ERR_HTMLAREA]:eq(0)","Data":"null","HWA":".","Children":[]},{"Lbl":"error_items","Src":"div[id*=RESP_ERR_HTMLAREA]","Data":"text","Children":[]},{"Lbl":"eventName","Src":"#AUC_HDR_ZZ_AUC_NAME,#AUC_HDR_AUC_NAME","Data":"text","HWA":".","Children":[]},{"Lbl":"eventIdLabel","Src":"div[id*='divRESP_AUC_H0B_WK_AUC_ID_BUS_UNITlbl'] > span","Data":"text","Children":[]},{"Lbl":"eventId","Src":"#RESP_AUC_H0B_WK_AUC_ID_BUS_UNIT","Data":"text","HWA":".","Children":[]},{"Lbl":"eventFormatLabel","Src":"div[id*='divRESP_AUC_H0B_WK_AUC_FORMAT_BIDBERlbl'] > span","Children":[]},{"Lbl":"format1","Src":"#RESP_AUC_H0B_WK_AUC_FORMAT_BIDBER","Data":"text","Children":[]},{"Lbl":"format2","Src":"#AUC_HDR_AUC_TYPE","Data":"text","Children":[]},{"Lbl":"eventStartDateLabel","Src":"div[id*=divAUC_HDR_AUC_DTTM_STARTlbl] > span","Data":"text","Children":[]},{"Lbl":"eventStartDate","Src":"#AUC_HDR_AUC_DTTM_START","Data":"text","HWA":".","Children":[]},{"Lbl":"dept","Src":"#SP_BU_GL_CLSVW_DESCR,#BUS_UNIT_TBL_FS_DESCR","Data":"text","Children":[]},{"Lbl":"eventVersionLabel","Src":"div[id*=divAUC_HDR_AUC_VERSIONlbl] > span","Data":"text","Children":[]},{"Lbl":"eventVersion","Src":"#AUC_HDR_AUC_VERSION","Data":"text","HWA":".","Children":[]},{"Lbl":"eventEndDateLabel","Src":"div[id*=divAUC_HDR_AUC_DTTM_FINISHlbl] > span","Data":"text","Children":[]},{"Lbl":"eventEndDate","Src":"span[id='AUC_HDR_AUC_DTTM_FINISH']","Data":"text","HWA":".","Children":[]},{"Lbl":"desc","Src":"#AUC_HDR_DESCRLONG","Data":"text","Children":[]},{"Lbl":"prevPageZZ_UNSPSC_CD_VW","Src":"a[id='ZZ_UNSPSC_CD_VW$hup$0']","Data":"id name","HWA":".","Children":[]},{"Lbl":"pagePosZZ_UNSPSC_CD_VW","Src":"div[id*='ZZ_UNSPSC_CD_VWGP'] span[class=PSGRIDCOUNTER]","Data":"text","HWA":".","Children":[]},{"Lbl":"downloadPageZZ_UNSPSC_CD_VW","Src":"a[id^='ZZ_UNSPSC_CD_VW$hexcel']:eq(0)","Data":"id name","HWA":".","Children":[]},{"Lbl":"nextPageZZ_UNSPSC_CD_VW","Src":"a[id='ZZ_UNSPSC_CD_VW$hdown$0']","Data":"id name","HWA":".","Children":[]},{"Lbl":"licenseRow","Src":"tr[id^='trZZ_UNSPSC_CD_VW$0_row']","Data":"id","HWA":".","Children":[{"Lbl":"licensecode","Src":"[id^='ZZ_LICENS_CD_VW_LICENSE_CODE$']","Data":"text","Children":[]},{"Lbl":"licensedesc","Src":"[id^='ZZ_CLS_CD_VW_DESCR254$']","Data":"text","Children":[]}]},{"Lbl":"prevPageZZ_AU
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值