爬虫之Boss直聘 招聘数据采集

前言

大家早好、午好、晚好吖 ❤ ~欢迎光临本文章

如果有什么疑惑/资料需要的可以点击文章末尾名片领取源码

环境介绍:

• python 3.8 解释器: 执行代码的

• pycharm 专业版: 写代码的 帮助我们 快速开发代码的

第三方模块

• DrissionPage

win + R 输入cmd 输入安装命令 pip install 模块名 (如果你觉得安装速度比较慢, 你可以切换国内镜像源)

文章不理解的话，我还准备了视频讲解，和代码一起打包好了，文末名片自取

代码展示：

导入模块

from DrissionPage import WebPage
from DataRecorder import Recorder

'''
python资料获取看这里噢！！ 小编 V：qian97378，即可获取：
文章源码/教程/资料/解答等福利，还有不错的视频学习教程和PDF电子书！
'''
r = Recorder('boss.xlsx')
r.add_data(['jobName', 'salaryDesc', 'jobExperience', 'jobDegree', 'cityName', 'areaDistrict', 'businessDistrict', 'brandName', 'brandIndustry', 'brandStageName', 'brandScaleName', 'welfareList', 'skills'])
r.record()
wp = WebPage()
wp.listen.start('zpgeek/search/joblist.json')
wp.get('https://www.zhipin.com/web/geek/job?query=python%E7%88%AC%E8%99%AB&city=100010000&page=1')
for page in range(10):
    packet = wp.listen.wait()
    jobList = packet.response.body['zpData']['jobList']
    data_list = []
    for job in jobList:
        jobName = job['jobName']
        salaryDesc = job['salaryDesc']
        jobExperience = job['jobExperience']
        jobDegree = job['jobDegree']
        cityName = job['cityName']
        areaDistrict = job['areaDistrict']
        businessDistrict = job['businessDistrict']
        brandName = job['brandName']
        brandIndustry = job['brandIndustry']
        brandStageName = job['brandStageName']
        brandScaleName = job['brandScaleName']
        welfareList = ','.join(job['welfareList'])
        skills = ','.join(job['skills'])
        print(jobName, salaryDesc, jobExperience, jobDegree, cityName, areaDistrict, businessDistrict, brandName, brandIndustry, brandStageName, brandScaleName, welfareList, skills)
        data_list.append([jobName, salaryDesc, jobExperience, jobDegree, cityName, areaDistrict, businessDistrict, brandName, brandIndustry, brandStageName, brandScaleName, welfareList, skills])
    r.add_data(data_list)
    r.record()
    wp.run_js('document.querySelector("i.ui-icon-arrow-right").click()')

尾语

最后感谢你观看我的文章呐~本次航班到这里就结束啦 🛬

希望本篇文章有对你带来帮助 🎉，有学习到一点知识~

躲起来的星星🍥也在努力发光，你也要努力加油（让我们一起努力叭）。

最后，宣传一下呀~👇👇👇更多源码、资料、素材、解答、交流皆点击下方名片获取呀👇👇