配置Scrapy环境,直接用下面的命令:
pip install scrapy
出现错误:
You are using pip version 18.1, however version 20.2b1 is available.
You should consider upgrading via the 'python -m pip install --upgrade pip' command.
再用下面的命令更新pip:
python -m pip install --upgrade pip -i https://pypi.douban.com/simple
再用下面的命令就可以配置成功:
pip install scrapy -i https://pypi.douban.com/simple
进行测试:
import scrapy print(scrapy.version_info)
或者直接scrapy
C:\Users\cwl>scrapy
Scrapy 2.1.0 - no active project
Usage:
scrapy <command> [options] [args]
Available commands:
bench Run quick benchmark test
fetch Fetch a URL using the Scrapy downloader
genspider Generate new spider using pre-defined templates
runspider Run a self-contained spider (without creating a project)
settings Get settings values
shell Interactive scraping console
startproject Create new project
version Print Scrapy version
view Open URL in browser, as seen by Scrapy
[ more ] More commands available when run from project directory
Use "scrapy <command> -h" to see more info about a command
成功!