爬虫
Cep�Murphy laws
这个作者很懒,什么都没留下…
展开
-
xpath 爬取起点小说 写入mysql前端
import requestsimport lxml.etree as etreedef getBook(url): response = requests.get(url) response.encoding='utf-8' #print(response) # 生成选择器对象 selector = etree.HTML(response.text)...原创 2020-03-04 16:34:43 · 355 阅读 · 1 评论 -
爬取股票数据
import requestsfrom bs4 import BeautifulSoupimport pymongoclient = pymongo.MongoClient(host='localhost',port=27017,connect=False)stocks = client['stock']stock_data = stocks['stock_data']if "stoc...原创 2020-02-28 12:12:48 · 269 阅读 · 1 评论 -
爬虫 python 爬取澎湃新闻
import requestsimport pymongofrom bs4 import BeautifulSoupimport getNewsclient = pymongo.MongoClient(host='localhost',port=27017,connect=False)pengpai = client['pengpai']if 'pengpai_news' in pe...原创 2020-02-13 16:36:58 · 1865 阅读 · 0 评论 -
Pytohn3 爬取王者荣耀 官网壁纸并下载数据到本地
import requestsimport jsonfrom urllib import parseimport osp1 = 'https://apps.game.qq.com/cgi-bin/ams/module/ishow/V1.0/query/workList_inc.cgi?activityId=2735&sVerifyCode=ABCD&sDataType=JS...原创 2020-02-20 21:58:45 · 493 阅读 · 1 评论 -
Python 爬取豆瓣250电影并写入Mongodb数据库
import requestsimport jsonimport pymongourlList = ["https://movie.douban.com/j/search_subjects?type=tv&tag=%E7%BE%8E%E5%89%A7&sort=recommend&page_limit=20&page_start=" + str(n) ...原创 2020-02-09 17:12:00 · 903 阅读 · 0 评论 -
Python3爬虫小说章节内容
import requestsfrom bs4 import BeautifulSoupimport txtreadurl = ‘https://www.biqukan.com/0_790/’responce = requests.get(url)responce.encoding = ‘gbk’html = responce.textsoup = BeautifulSoup(htm...原创 2019-09-13 02:54:52 · 431 阅读 · 0 评论 -
Python3爬去新浪新闻写入mysql
import pymysqlimport requestsfrom bs4 import BeautifulSoupurl = ‘https://news.sina.com.cn/world/’response = requests.get(url)response.encoding = “utf-8”html = response.textsoup = BeautifulSoup(...原创 2019-09-12 14:17:35 · 192 阅读 · 0 评论 -
Python3爬虫 小说
Python 与 Mysql 爬虫小说学习欢迎使用Markdown编辑器新的改变功能快捷键合理的创建标题,有助于目录的生成如何改变文本的样式插入链接与图片如何插入一段漂亮的代码片生成一个适合你的列表创建一个表格设定内容居中、居左、居右SmartyPants创建一个自定义列表如何创建一个注脚注释也是必不可少的KaTeX数学公式新的甘特图功能,丰富你的文章UML 图表FLowchart流程图导出与导入...原创 2019-09-12 14:08:34 · 343 阅读 · 0 评论