![](https://img-blog.csdnimg.cn/20201014180756928.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
scrapy
文章平均质量分 82
愤怒的苹果ext
本人擅长Ai、Fw、Fl、Br、Ae、Pr、Id、Ps等软件的安装与卸载,精通CSS、JavaScript、PHP、ASP、C、C++、C#、Java、Ruby、Perl、Lisp、python、Objective-C、ActionScript、Pascal等单词的拼写,熟悉Windows、Linux、Mac、Android、IOS、WP8等系统的开关机.
展开
-
scrapy splash模拟点击
目录背景使用splash文档安装背景遇到的问题:在做爬虫时遇到用js跳转链接的并且跳转的链接是加了密的,不好做拼接,这个时候一般解决办法就是模拟点击了。scrapy模拟点击的话一般是用selenium或者splash,我这里使用的是splash,貌似官方也是推荐用splash使用splash文档github https://github.com/scrapy-plugins...原创 2020-01-14 20:53:11 · 3785 阅读 · 9 评论 -
No module named 'scrapy.pipeline'
做scrapy爬虫的时候导入下载的Pipeline报错2020-01-04 20:45:21 [twisted] CRITICAL: Traceback (most recent call last): File "D:\software\Python35\lib\site-packages\twisted\internet\defer.py", line 1386, in _inli...原创 2020-01-04 20:52:07 · 854 阅读 · 0 评论 -
运行Scrapy程序 error: No module named _util
解决方案: pip install pyopenssl --user --upgrade原创 2019-11-25 20:22:39 · 551 阅读 · 0 评论 -
Cannot uninstall 'pyOpenSSL'. It is a distutils installed project and thus we cannot accurately dete
linux python2.7安装scrapy报错 ERROR: Cannot uninstall ‘pyOpenSSL’. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial ...原创 2019-11-25 19:55:24 · 2176 阅读 · 0 评论 -
windows安装scrapy异常 error : Unable to find vcvarsall.bat
使用pip install scrapy安装scrapy时抛出异常 error : Unable to find vcvarsall.bat 原因就是缺少C的编译环境。解决方案一 : 安装相对应版本的Visual Studio ,就会有C的编译环境了,Visual Studio软件比较笨重,不推荐这种方法。解决方案二:到https://www.lfd.uci.edu/~gohlke/pyt...原创 2018-03-30 23:17:45 · 378 阅读 · 0 评论