- 博客(10)
- 资源 (2)
- 收藏
- 关注
RSS订阅原创 xpath 爬取起点小说 写入mysql前端
import requestsimport lxml.etree as etreedef getBook(url): response = requests.get(url) response.encoding='utf-8' #print(response) # 生成选择器对象 selector = etree.HTML(response.text)...
2020-03-04 16:34:43
351
1
原创 爬取股票数据
import requestsfrom bs4 import BeautifulSoupimport pymongoclient = pymongo.MongoClient(host='localhost',port=27017,connect=False)stocks = client['stock']stock_data = stocks['stock_data']if "stoc...
2020-02-28 12:12:48
262
1
原创 Pytohn3 爬取王者荣耀 官网壁纸并下载数据到本地
import requestsimport jsonfrom urllib import parseimport osp1 = 'https://apps.game.qq.com/cgi-bin/ams/module/ishow/V1.0/query/workList_inc.cgi?activityId=2735&sVerifyCode=ABCD&sDataType=JS...
2020-02-20 21:58:45
490
1
原创 爬虫 python 爬取澎湃新闻
import requestsimport pymongofrom bs4 import BeautifulSoupimport getNewsclient = pymongo.MongoClient(host='localhost',port=27017,connect=False)pengpai = client['pengpai']if 'pengpai_news' in pe...
2020-02-13 16:36:58
1842
原创 Python 爬取豆瓣250电影并写入Mongodb数据库
import requestsimport jsonimport pymongourlList = ["https://movie.douban.com/j/search_subjects?type=tv&tag=%E7%BE%8E%E5%89%A7&sort=recommend&page_limit=20&page_start=" + str(n) ...
2020-02-09 17:12:00
896
原创 Python3爬虫小说章节内容
import requestsfrom bs4 import BeautifulSoupimport txtreadurl = ‘https://www.biqukan.com/0_790/’responce = requests.get(url)responce.encoding = ‘gbk’html = responce.textsoup = BeautifulSoup(htm...
2019-09-13 02:54:52
428
原创 Python3爬去新浪新闻写入mysql
import pymysqlimport requestsfrom bs4 import BeautifulSoupurl = ‘https://news.sina.com.cn/world/’response = requests.get(url)response.encoding = “utf-8”html = response.textsoup = BeautifulSoup(...
2019-09-12 14:17:35
185
原创 Python3批量合并excel 格式xlsx和xls都行
import xlrdimport osimport xlwtFolderPath = r"C:\Users\Administrator.WIN10-803072322\Desktop\贺虎"pathsDir = os.listdir(FolderPath)#获取文件夹中表格的路径 并且放入到列表中PathList = []for LogsPath in pathsDir:Exce...
2019-09-12 14:14:00
580
原创 Python3爬虫 小说
Python 与 Mysql 爬虫小说学习欢迎使用Markdown编辑器新的改变功能快捷键合理的创建标题，有助于目录的生成如何改变文本的样式插入链接与图片如何插入一段漂亮的代码片生成一个适合你的列表创建一个表格设定内容居中、居左、居右SmartyPants创建一个自定义列表如何创建一个注脚注释也是必不可少的KaTeX数学公式新的甘特图功能，丰富你的文章UML 图表FLowchart流程图导出与导入...
2019-09-12 14:08:34
339
空空如也
TA创建的收藏夹 TA关注的收藏夹
TA关注的人