Python 爬取微信公众号所有文章集合(playwright+自动往下滑动）

大家好！今天给你们带来了通过playwright+自动滑动实现爬取微信公众号所有历史文章标题和链接，仅供学习！

import re
from playwright.sync_api import sync_playwright
def main():
    with sync_playwright() as p:
        browser = p.chromium.launch()
        context = browser.new_context()
        page = context.new_page()
        #访问网页
        page.goto("https://mp.weixin.qq.com/mp/appmsgalbum?__biz=MzkxNzU2Nzg2NQ==&action=getalbum&album_id=3101281634991243270&scene=173&subscene=&sessionid=svr_e2f2637693e&enterid=1708590301&from_msgid=2247484919&from_itemidx=1&count=3&nolastread=1#wechat_redirect")
        #等待数据加载完成
        page.wait_for_load_state("load")
        #获取内容数量
        content_count_element = page.query_selector('.album__desc-content.js_album_desc_content > span')
        content_count_text = content_count_element.inner_text()
        content_count = int(re.search(r'\d+', content_count_text).group()) // 10
        #滑动页面
        for _ in range(content_count):
            print("第"+str(_+1)+"次滑动.....")
            page.evaluate("window.scrollTo(0, document.body.scrollHeight)")
            page.wait_for_timeout(2000)

        #获取标题
        list_items = page.query_selector_all(".album__list.js_album_list > .album__list-item")
        #输出标题和链接
        for item in list_items:
            data_link = item.get_attribute("data-link")
            data_title = item.get_attribute("data-title")
            print(f"标题: {
     data_title}\n链接: {
     data_link}\n*****\n")
        browser.close()
main()

输出：

标题: Python 爬取各搜索引擎提示词
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484919&idx=1&sn=39086f3f1cde46a6f67b56483d7228a8&chksm=c1bfe5e1f6c86cf7d3d7d29e4a400f7534093f0ac261db5dce2f4ed68e09118e73422446633b#rd
*****

标题: python下雪效果
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484905&idx=1&sn=93d8ca69ddbb04d7035531d097b23522&chksm=c1bfe5fff6c86ce9966df41164d172db7d7c714f5ef60119e209186b5a73756c7a6e3e96cc92#rd
*****

标题: Python制作简单拼图效果
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484901&idx=1&sn=e0c33671ad5ff182290173c437ac7360&chksm=c1bfe5f3f6c86ce532a043efad30384c07a674f6b78af5bb1aa4751176fd74d1148a31fe1fdb#rd
*****

标题: Python制作简单表格
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484895&idx=1&sn=895c5d08140049903f27ec6087103dbe&chksm=c1bfe5c9f6c86cdf5121e980ea81e1b868a32d2eac3700b8397842eedc3f5b5cacc5956d8ca6#rd
*****

标题: Python玩转PIL库（2）
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484887&idx=1&sn=42fe8868a4dfbb8c24230df57c9624e4&chksm=c1bfe5c1f6c86cd74af2bf78928d1b73c56f6b4f584ffecffe9d28159b2deddee59e59c35640#rd
*****

标题: Python玩转PIL库
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484883&idx=1&sn=b0a19ddcb6cc4b955aa47de66f1b819d&chksm=c1bfe5c5f6c86cd31c6db798e32b37d886057cf19b819296eb2e1928ede6a602685cba704bd9#rd
*****

标题: Python 我的世界游戏（3D）
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484879&idx=1&sn=e2c36720f8f5c9e092ff17b37bafa4ec&chksm=c1bfe5d9f6c86ccf500644a8e35a8da570780eaa2d279fba0dabfadafdab8c3290578d0b3bc0#rd
*****

标题: Python 扫雷游戏
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484872&idx=1&sn=7e45db02da585c9a1b96d4a0a28add19&chksm=c1bfe5def6c86cc8b7c7e107a2515b03f7532d4a9479e813516b4d74de06dc3bbccdc786d4ff#rd
*****

标题: Python 坠落的小鸟游戏
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484868&idx=1&sn=f915ab88caa9614d4da1aab019e7939d&chksm=c1bfe5d2f6c86cc48f8d2c903e612dd4c0ccfbff8fcb2803cd13148b12ac4b56731a02b6c89b#rd
*****

标题: Python贪吃蛇游戏
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484864&idx=2&sn=3422ead374e885ea16e6d2e53e670ce6&chksm=c1bfe5d6f6c86cc07819a76e7f86f1616a5133d3a53060ad926fd50c1dd6c4c03dab181c60ba#rd
*****

标题: Python消消乐游戏
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484858&idx=1&sn=f7471408c62f33cc57037f071dd7b6e4&chksm=c1bfe5acf6c86cbac7887d7267b1e640b375671155f3c9d4f45aea2fd2deb605e3783237b835#rd
*****

标题: Python飞机大战游戏
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484850&idx=1&sn=673ca5069423665b89968b2b60313f85&chksm=c1bfe5a4f6c86cb2a96e0af643220460d382e0384342682cb477b5c0f3ca6e4cc83940bed543#rd
*****

标题: Python新年烟花效果代码(2024版)
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484846&idx=1&sn=c834b5930c12e3e4e92df70f625d6353&chksm=c1bfe5b8f6c86caea72c0f473d944f13b22ae8ecd723b3823e29d00d249554745cb087f34120#rd
*****

标题: Python中pyhttpx和requests怎么选？
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484842&idx=1&sn=ee2cbfcbfb2d23aea9f81f60bc84e43e&chksm=c1bfe5bcf6c86caa59394610b8c4829fd9c62370fbb2c34fdd53cd4568cc9edb6e45f9911d15#rd
*****

标题: Python地表最强wifi密码暴力破解工具
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484838&idx=1&sn=8f43bc0be0ce5ad515a09bf84c262b48&chksm=c1bfe5b0f6c86ca6809af1ec4d115c86e8266243279dfc44bb4475959dffe3953565563984eb#rd
*****

标题: Python爬取最新电影预告片信息
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484828&idx=1&sn=994ece6038500ff20ae627408b9f4177&chksm=c1bfe58af6c86c9c126504c37fe833569cd45bedca05713077d3227c2052d0745535dcf2f6a6#rd
*****

标题: 27个实用Python实例
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484824&idx=1&sn=935f0f6575ca991e05db30e9cac3c4ab&chksm=c1bfe58ef6c86c984fb18f0632cb66f29f2aed39e3a68ec5233cd301345549a44e2e5bb5f90d#rd
*****

标题: Python俄罗斯方块游戏
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484820&idx=1&sn=e539fca0920b69b3fc974ed44371be5a&chksm=c1bfe582f6c86c94fa3985eeeda05322c0d1cf2c207a30552a986e1c83b4bc6687ad2e9016c9#rd
*****

标题: python黑客装逼神器！
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484816&idx=1&sn=58465fbb3a2bbdb14ec3fd8aedca0124&chksm=c1bfe586f6c86c9047769989364a99e4ffb26f5cf424e639f062569667b39262be62cf2bb1f6#rd
*****

标题: Python春节烟花效果
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484805&idx=1&sn=6958cb9f50e3ab7ef1619f8e8bb4a07a&chksm=c1bfe593f6c86c851d05cb2cde1f5b7501ab65abbfdffe2845d1b9a7749a2cd1d709b1f93570#rd
*****

标题: 9个实用python实例
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484797&idx=1&sn=3b3dfa353e4f4ddccab7f8438c04102d&chksm=c1bfe56bf6c86c7d68d02c16dea755ca9a2af8b8e09db66e3a403e345d28ca4f0707a2f9063e#rd
*****

标题: Python爬取电影搜索结果以及下载链接
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484793&idx=2&sn=f016e3c8b4fcb657db60f5ffc94b71ae&chksm=c1bfe56ff6c86c7972e253d3b86ce73520ba15b8b5058757b10c5c108fbd03bf1cb06635f46c#rd
*****

标题: Python六种生成随机密码超实用实例
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=2247484785&idx=1&sn=7d225a246e5b2be2e27b6ce72d694b62&chksm=c1bfe567f6c86c7149815166d2d1b0eb0819eb49dbdf00cde69e83ee2e4104e851e513059f71#rd
*****

标题: Python爬取蜘蛛呀搜索引擎搜索结果
链接: http://mp.weixin.qq.com/s?__biz=MzkxNzU2Nzg2NQ==&mid=