java 调用 scrapy_使用scrapy前的环境搭建

刚开始直接scrapy startproject [名称] 创建项目才遇到挺多问题的，执行这个又会提示那个问题，解决后就觉得还好还好啦

1.pip install scrapy 提示pip 版本要升级；

You are using pip version 10.0.1, however version 10.0.1 is available.

You should consider upgrading via the 'python -m pip install --upgrade pip' command.

2.python -m pip install --upgrade pip 升级时又有新问题；

(venv) D:\Fish>python -m pip install --upgrade pip

Requirement already up-to-date: pip in d:\fish\venv\lib\site-packages (10.0.1)

于是按照要求将d:\fish\venv\lib\site-packages (10.0.1) 中的pip-10.0.1.dist-info删除，再次运行python -m pip install --upgrade pip 后升级成功

3.再执行第1步以为万事大吉了，又有新的问题了

error: Microsoft Visual C++ 14.0 is required. Get it with "Microsoft Visual C++ Build Tools": http://landinghub.visualstudio.com/visual-cpp-build-tools

解决这个问题有两种方法：a.按提示安装Visual Studio (C盘至少需要6G空间，果断找其他方法解决