python
luogan129
这个作者很懒,什么都没留下…
展开
-
Chrome与chromedriver.exe的版本对应
Chrome与chromedriver.exe的版本对应查看本地安装的谷歌浏览器chrome://version/下载地址1:http://npm.taobao.org/mirrors/chromedriver/http://npm.taobao.org/mirrors/chromedriver/84.0.4147.30/原创 2020-09-05 16:38:02 · 825 阅读 · 0 评论 -
python mongodb
Navicat 12 for MongoDB不要在安装 PyCharm 的 mongo 插件了原创 2020-09-05 14:29:00 · 95 阅读 · 0 评论 -
mitmproxy
检查是否安装成功pip3 --versionpython3 --version下面是安装mitmprox步骤下载mitproxy源代码wget https://github.com/mitmproxy/mitmproxy/archive/v4.0.3.zip解压unzip mitproxy-4.0.3.zip确认python3.6版本以上的命令是python3,不然根据具体情况...原创 2019-08-29 17:32:50 · 129 阅读 · 0 评论 -
Linux CentOS 7.6安装python3.7以及pip19
本文链接:https://blog.csdn.net/qq_39680564/article/details/90519461pip3 install mitmproxy转载 2019-08-29 16:34:49 · 432 阅读 · 0 评论 -
python(安装步骤)
下载https://www.jetbrains.com/pycharm/download/#section=windows下载 Python 包https://www.anaconda.com/distribution/原创 2019-08-01 17:18:24 · 247 阅读 · 0 评论 -
pthon爬虫(6)mongo数据库
安装 pymongo 第三方库(通过anaconda)import pymongoclient = pymongo.MongoClient('localhost',27017)walden = client['walden']sheet_tab = walden['sheet_tab']path = 'C:\data\walden.txt'with open(path,'r') as f:翻译 2017-05-07 21:17:57 · 334 阅读 · 0 评论 -
python(四)
批量获取链接 定义函数from bs4 import BeautifulSoupimport requestsurl = 'http://bj.xiaozhu.com/fangzi/1508951935.html'wb_data = requests.get(url)soup = BeautifulSoup(wb_data.text,'lxml')title = soup.select('原创 2017-02-12 18:05:13 · 234 阅读 · 0 评论 -
python爬虫(三)
爬虫手机端 headersfrom bs4 import BeautifulSoupimport requestsheaders = { 'User-Agent':'Mozilla/5.0 (iPhone; CPU iPhone OS 9_1 like Mac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Version/9.0 Mobi原创 2017-02-12 16:56:21 · 318 阅读 · 0 评论 -
python爬虫(一)
抓取 标题,图片,链接,多个文字 listfrom bs4 import BeautifulSoupimport requestsurl = 'https://cn.tripadvisor.com/Attractions-g60763-Activities-New_York_City_New_York.html'wb_data = requests.get(url)soup =原创 2017-02-12 14:26:14 · 317 阅读 · 0 评论 -
python爬虫(2-2)
抓取58链接 存储到mongofrom bs4 import BeautifulSoupimport requestsimport timeimport pymongoclient = pymongo.MongoClient('localhost',27017)ceshi = client['ceshi']url_list = ceshi['url_list3']#spider原创 2017-02-10 16:43:24 · 306 阅读 · 0 评论