python3.7 Scrapy在Windows平台的安装

1.安装python并配置好环境变量

2.更新pip ，这步操作时遇到了问题，更新超时了，所以加上–default-timeout来解决超时问题：python -m pip --default-timeout=100 install --upgrade pip

3.安装lxml ：pip intsall lxml

4.安装wheel： pip install wheel

5.在python lib网站上以下安装包，然后使用pip install xxx 安装：

Twisted-18.9.0-cp37-cp37m-win_amd64.whl

pywin32-224-cp37-cp37m-win_amd64.whl

Scrapy-1.6.0-py2.py3-none-any.whl

Python Lib网站：https://www.lfd.uci.edu/~gohlke/pythonlibs/

6.Scrapy调试，验证是否安装成功：

C:\Users\admin>scrapy
Scrapy 1.6.0 - no active project

Usage:
scrapy [options] [args]

Available commands:
bench Run quick benchmark test
fetch Fetch a URL using the Scrapy downloader
genspider Generate new spider using pre-defined templates
runspider Run a self-contained spider (without creating a project)
settings Get settings values
shell Interactive scraping console
startproject Create new project
version Print Scrapy version
view Open URL in browser, as seen by Scrapy

[ more ] More commands available when run from project directory

Use “scrapy -h” to see more info about a command

部分安装日志如下：

C:\Users\admin>pip install pywin32-224-cp37-cp37m-win_amd64.whl
Processing c:\users\admin\pywin32-224-cp37-cp37m-win_amd64.whl
Installing collected packages: pywin32
Successfully installed pywin32-224

C:\Users\admin>pip install Scrapy-1.6.0-py2.py3-none-any.whl
Processing c:\users\admin\scrapy-1.6.0-py2.py3-none-any.whl
Collecting PyDispatcher>=2.0.5 (from Scrapy1.6.0)
Downloading https://files.pythonhosted.org/packages/cd/37/39aca520918ce1935bea9c356bcbb7ed7e52ad4e