Python爬虫
forthenight996
这个作者很懒,什么都没留下…
展开
-
Python淘宝商品比价定向爬虫
#淘宝商品比价定向爬虫import requestsimport re def getHTMLText(url): try: headers = {'cookie':'thw=cn; v=0; t=ab66dffdedcb481f77fd563809639584; cookie2=1f14e41c704ef58f8b66ff509d0d122e; _tb_token_=5e6bed8635536; cna=fGOnFZvieDECAXWIVi96eKju; unb=18...原创 2022-02-02 12:05:04 · 670 阅读 · 0 评论 -
Python豆瓣电影top250爬取
豆瓣电影top250爬取import requestsfrom bs4 import BeautifulSoupimport bs4def geturl(url): try: headers={'User-Agent':'Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.157 Safari/537.36'}#构造头部 ...原创 2022-01-28 10:27:50 · 690 阅读 · 0 评论 -
Python爬取bilibili番剧排行
爬取bilibili番剧排行import requests from bs4 import BeautifulSoupimport bs4import redef get_url(url): try: r=requests.get(url,timeout=30) r.raise_for_status() r.encoding=r.apparent_encoding return r.text except: ...原创 2022-01-28 10:24:43 · 1984 阅读 · 0 评论 -
Python爬取steam特惠促销榜
Python爬取steam特惠促销榜用python爬取https://store.steampowered.com/search/?os=win&specials=1&filter=topsellers的steam特惠促销信息import requestsfrom bs4 import BeautifulSoupimport bs4def Get_html(url): try: r=requests.get(url,timeout=30)原创 2021-04-14 20:02:01 · 1244 阅读 · 1 评论