爬虫
小神龙q
Q
展开
-
python爬虫小测试
python多线程处理爬虫数据原创 2022-07-04 17:57:22 · 359 阅读 · 0 评论 -
话不多说,试试就好
import requestsimport json,os,timesinger_list = ["陈奕迅"]class QQmusic: def __init__(self): self.headers = {'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.131 Safari/537.36'}转载 2021-04-10 14:40:18 · 85 阅读 · 0 评论 -
python爬取‘豆瓣电影’之数据获取
from bs4 import BeautifulSoupfrom urllib import requestimport jsonfrom urllib import parseurl = ‘https://movie.douban.com/j/search_tags?type=movie&source=’req = request.Request(url)json_res ...原创 2019-04-04 19:54:32 · 500 阅读 · 0 评论 -
爬取王者荣耀英雄图片
import osimport requestsurl = 'https://pvp.qq.com/web201605/js/herolist.json'html = requests.get(url)html = html.json()heroname = list(map(lambda x: x['cname'], html))heronum = list(map(lambda x...转载 2019-05-03 23:03:43 · 1047 阅读 · 0 评论 -
爬取上海好玩的地方排名(去哪儿网)
import requestsimport pandas as pdimport numpy as npfrom bs4 import BeautifulSoupdef get_urls(n): return ['https://travel.qunar.com/p-cs299878-shanghai-jingdian-1-' + str(i+1) for i in range(n)...原创 2019-05-03 23:19:26 · 539 阅读 · 0 评论 -
Python爬取在线视频
import requestsimport osurl="http://svideo.spriteapp.com/video/2019/0425/01bd6eba673e11e9af3d842b2b4c75ab_wpd.mp4"root = "D://pics//"path = root+url.split('/')[-1]#获得一个url最后一个/后的字符串try: if no...转载 2019-05-03 23:21:48 · 785 阅读 · 0 评论