web爬虫 - 实例一（猿人学17题）

励志的大鹰哥

已于 2023-09-21 10:16:44 修改

阅读量159

点赞数

分类专栏：爬虫实战系列文章标签：前端爬虫数据库

于 2023-08-03 16:42:54 首次发布

本文链接：https://blog.csdn.net/CSDN_Xying/article/details/132087064

版权

爬虫实战系列专栏收录该内容

6 篇文章 1 订阅

订阅专栏

这个案例很简单，不多说了

import httpx

def get_info(ind):
    url = "https://match.yuanrenxue.cn/api/match/17?page=" + str(ind)
    headers = {
        'authority': 'match.yuanrenxue.com',
        'cookie': 'Hm_lvt_c99546cf032aaa5a679230de9a95c7db=1690184377,1690941596,1690969392,1690971468; Hm_lvt_9bcbda9cbf86757998a2339a0437208e=1690184376,1690941595,1690969392,1690971468; Hm_lvt_434c501fe98c1a8ec74b813751d4e3e3=1690971476; Hm_lpvt_434c501fe98c1a8ec74b813751d4e3e3=1690971476; tk=-7962460354862954537; sessionid=1mcld1cz4z54nrnhkuxfq7wtysc7vdds; Hm_lpvt_9bcbda9cbf86757998a2339a0437208e=1691027865; Hm_lpvt_c99546cf032aaa5a679230de9a95c7db=1691027869',
            'referer': 'https://match.yuanrenxue.com/match/3',
        'user-agent': 'yuanrenxue.project',
    }

    client = httpx.Client(http2=True)
    resp = client.get(url=url, headers=headers)
    res_json = resp.json()

    sum = 0
    for val_dict in res_json['data']:
        sum += val_dict['value']
    return sum


if __name__ == '__main__':
    sum_num = 0
    for i in range(1, 6):
        res = get_info(i)
        sum_num += int(res)
    print(sum_num)