人生苦短,我用python
第一步 安装Scrapy
pip install scrapy 报错
error: Microsoft Visual C++ 14.0 is required. Get it with "Microsoft Visual C++ Build Tools": http://landinghub.visualstudio.com/visual-cpp-build-
解决办法如下:
http://www.lfd.uci.edu/~gohlke/pythonlibs/#twisted下载twisted对应版本的whl文件Twisted‑17.5.0‑cp36‑cp36m‑win_amd64.whl,cp后面是python版本,amd64代表64位,运行
pip install C:\Users\CR\Downloads\Twisted-17.5.0-cp36-cp36m-win_amd64.whl 其中install后面为完整路径名 ,安装完成后,再次运行
运行
pip install scrapy 就行了。
输入 scrapy 出现
G:\下载\迅雷下载>scrapy
Scrapy 1.4.0 - no active project
Usage:
scrapy <command> [options] [args]
Available commands:
bench Run quick benchmark test
fetch Fetch a URL using the Scrapy downloader
genspider Generate new spider using pre-defined templates
runspider Run a self-contained spider (without creating a project)
settings Get settings values
shell Interactive scraping console
startproject Create new project
version Print Scrapy version
view Open URL in browser, as seen by Scrapy
[ more ] More commands available when run from project directory
Use "scrapy <command> -h" to see more info about a command
报错 ModuleNotFoundError: No module named ‘win32api’
解决 去 https://sourceforge.net/projects/pywin32/files/ 下载安装pywin32
证明安装成功。