Python—爬取简历模板案例(Xpath方法)

小枫Geek

已于 2022-03-25 20:54:32 修改

阅读量1k

点赞数 2

分类专栏：爬虫 Xpath python 文章标签： python 开发语言 xpath 爬虫

于 2022-02-28 19:46:55 首次发布

本文链接：https://blog.csdn.net/m0_65592409/article/details/123190342

版权

python 同时被 3 个专栏收录

37 篇文章 2 订阅

订阅专栏

爬虫

19 篇文章 1 订阅

订阅专栏

Xpath

5 篇文章 0 订阅

订阅专栏

源码：

import requests
import os
from lxml import etree

if not os.path.exists('./简历模板'):
    os.mkdir('./简历模板')

headers={
    'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36'
}
#1.输入url,获取网页数据
url='https://aspx.sc.chinaz.com/query.aspx?keyword=%E5%85%8D%E8%B4%B9&classID=864'
page_text=requests.get(url=url,headers=headers).text

#2.实例化etree对象,获取的源码数据加载到该对象中
tree=etree.HTML(page_text)
    #属性定位,数据解析
li_list=tree.xpath('//div[@class="sc_warp  mt20"]/div/div/div')

    #获取属性值@href、@alt
for li in li_list:
    target_url='https:'+li.xpath('./a/@href')[0]
    target_name=li.xpath('./a/img/@alt')[0]+'.rar'

#3.拿到各个网页的url,获取各个网页的数据
    resume_data=requests.get(url=target_url,headers=headers).text
    #实例网页数据对象
    resume_tree=etree.HTML(resume_data)
    #属性定位,数据解析
    resume_download=resume_tree.xpath('//div[@class="down_wrap"]/div[2]/ul/li[3]')

#4、获取属性值-每个简历对应的下载地址
    for download in resume_download:
        download_url=download.xpath('./a/@href')[0]

        resume_rar_page=requests.get(url=download_url,headers=headers).content
        target_Path='./简历模板/'+target_name
        with open(target_Path,'wb') as fp:
            fp.write(resume_rar_page)
            print(target_name+'成功！！！')
        # pass