一、install Scrapy
1、安装Scrapy
(C:\Users\AppData\Local\Continuum\Anaconda3) C:\Users>pip install Scrapy
安装失败,显示:
error: Microsoft Visual C++ 14.0 is required. Get it with "Microsoft Visual C++ Build Tools": http://landinghub.visualstudio.com/visual-cpp-build-tools
解决:
至:http://www.lfd.uci.edu/~gohlke/pythonlibs/#twisted 根据Python版本,下载Twisted,安装Twisted
(C:\Users\AppData\Local\Continuum\Anaconda3) C:\Users>pip install C:\Soft\Python\Twisted-17.9.0-cp36-cp36m-win_amd64.whl
2、再次安装Scrapy
(C:\Users\AppData\Local\Continuum\Anaconda3) C:\Users>pip install Scrapy
3、查看安装结果:
(C:\Users\AppData\Local\Continuum\Anaconda3) C:\Users>scrapy
4、Scrapy API:
http://scrapy-chs.readthedocs.io/zh_CN/0.24/topics/commands.html
二、 install Selenium
(C:\Users\AppData\Local\Continuum\Anaconda3) pip install Selenium
三、 install Phantomjs
下载phantomjs,解压不需要安装,设置Path环境变量:C:\Soft\Python\phantomjs\phantomjs-2.1.1-windows\bin
查看是否配置成功:
(C:\Users\AppData\Local\Continuum\Anaconda3) C:\Users>phantomjs -v
(C:\Users\AppData\Local\Continuum\Anaconda3) C:\Users>cd C:\Soft\Python\phantomjs\phantomjs-2.1.1-windows\examples
(C:\Users\AppData\Local\Continuum\Anaconda3) C:\Soft\Python\phantomjs\phantomjs-2.1.1-windows\examples>phantomjs hello.js
结果显示:Hello, world!
四、安装Mysql client
(C:\Users\AppData\Local\Continuum\Anaconda3) C:\Users\workspace\tyctest>pip install mysqlclient