我安装 scrapy时遇到一些问题,开始也查找各种资料,最终安装成功,下面把资料整理一下:
前提:网络要好,开始我是手机热点,下载一半报错。
第一步:安装更新pip.exe
开始检查到我python安装路径D:\python\Scripts处有pip.exe就直接进行了第二步,结果报错:‘’You are using pip version 10.0.1, however version 20.0.2 is available.”
You are using pip version 10.0.1, however version 20.0.2 is available.
You should consider upgrading via the 'python -m pip install --upgrade pip' command.
故根据提示,在cmd里输入:python -m pip install --upgrade pip
注意命令中有空格!
C:\Users\Big Bang>python -m pip install --upgrade pip
更新pip成功后显示:
C:\Users\Big Bang>python -m pip install --upgrade pip
Collecting pip
Downloading https://files.pythonhosted.org/packages/54/0c/d01aa759fdc501a58f431eb594a17495f15b88da142ce14b5845662c13f3/pip-20.0.2-py2.py3-none-any.whl (1.4MB)
100% |████████████████████████████████| 1.4MB 115kB/s
Installing collected packages: pip
Found existing installation: pip 10.0.1
Uninstalling pip-10.0.1:
Successfully uninstalled pip-10.0.1
Successfully installed pip-20.0.2
第二步:安装Twisted
首先检查自己的python哪个版本,参考这个资料:查看python的当前版本号,
我版本号为3.7.0
C:\Users\Big Bang>python
Python 3.7.0 (v3.7.0:1bf9cc5093, Jun 27 2018, 04:59:51) [MSC v.1914 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>>
>>>
然后去官网下载Twisted,不要去其他地方乱下载,官网文件地址Twisted-pypi,
进入官网后点击左侧的Download files,才进入文件所在网页,往下翻,找到对应的安装文件:
因为我的是win10,python版本号是3.7.0,所以选择箭头所指文件,cp37就是3.7版本,cp36就是3.6版本,还要注意自己的电脑是win还是linux;是32还是64位,一般都64位的。
再就是下载了,因要使用该文件保持路径,分别输入命令,我把它保存在python安装的位置,如图:
接下来又win+r,输入cmd,在命令框输入:pip install 文件路径,注意有空格和-此类符号。输入完按enter执行命令。
C:\Users\Big Bang>pip install D:\python\Twisted-19.10.0-cp37-cp37m-win_amd64.whl
模块自动安装,稍等片刻,完成后如同下:
C:\Users\Big Bang>pip install D:\python\Twisted-19.10.0-cp37-cp37m-win_amd64.whl
Processing d:\python\twisted-19.10.0-cp37-cp37m-win_amd64.whl
Collecting Automat>=0.3.0
Downloading Automat-20.2.0-py2.py3-none-any.whl (31 kB)
Collecting constantly>=15.1
Downloading constantly-15.1.0-py2.py3-none-any.whl (7.9 kB)
Collecting attrs>=17.4.0
Downloading attrs-19.3.0-py2.py3-none-any.whl (39 kB)
Collecting incremental>=16.10.1
Using cached incremental-17.5.0-py2.py3-none-any.whl (16 kB)
Collecting PyHamcrest>=1.9.0
Downloading PyHamcrest-2.0.2-py3-none-any.whl (52 kB)
|████████████████████████████████| 52 kB 13 kB/s
Collecting hyperlink>=17.1.1
Downloading hyperlink-19.0.0-py2.py3-none-any.whl (38 kB)
Collecting zope.interface>=4.4.2
Downloading zope.interface-4.7.1-cp37-cp37m-win_amd64.whl (134 kB)
|████████████████████████████████| 134 kB 17 kB/s
Collecting six
Using cached six-1.14.0-py2.py3-none-any.whl (10 kB)
Collecting idna>=2.5
Downloading idna-2.9-py2.py3-none-any.whl (58 kB)
|████████████████████████████████| 58 kB 13 kB/s
Requirement already satisfied: setuptools in d:\python\lib\site-packages (from zope.interface>=4.4.2->Twisted==19.10.0) (39.0.1)
Installing collected packages: six, attrs, Automat, constantly, incremental, PyHamcrest, idna, hyperlink, zope.interface, Twisted
Successfully installed Automat-20.2.0 PyHamcrest-2.0.2 Twisted-19.10.0 attrs-19.3.0 constantly-15.1.0 hyperlink-19.0.0 idna-2.9 incremental-17.5.0 six-1.14.0 zope.interface-4.7.1
第三步:
在前两步成功安装的前提下,接下来只要在命令框,输入
pip install scrapy
C:\Users\Big Bang>pip install scrapy
接下来是一系列的自动下载安装,保持网络通畅!成功后:
Collecting pyasn1-modules
Downloading pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
|████████████████████████████████| 155 kB 12 kB/s
Collecting pyasn1
Downloading pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
|████████████████████████████████| 77 kB 12 kB/s
Collecting cffi!=1.11.3,>=1.8
Downloading cffi-1.14.0-cp37-cp37m-win_amd64.whl (176 kB)
|████████████████████████████████| 176 kB 5.3 kB/s
Requirement already satisfied: setuptools in d:\python\lib\site-packages (from zope.interface>=4.1.3->scrapy) (39.0.1)
Requirement already satisfied: idna>=2.5 in d:\python\lib\site-packages (from hyperlink>=17.1.1->Twisted>=17.9.0->scrapy) (2.9)
Collecting pycparser
Downloading pycparser-2.20-py2.py3-none-any.whl (112 kB)
|████████████████████████████████| 112 kB 6.6 kB/s
Installing collected packages: protego, PyDispatcher, pyasn1, pyasn1-modules, pycparser, cffi, cryptography, service-identity, w3lib, cssselect, queuelib, lxml, parsel, pyOpenSSL, scrapy
Running setup.py install for protego ... done
Running setup.py install for PyDispatcher ... done
Success;fully installed PyDispatcher-2.0.5 cffi-1.14.0 cryptography-2.8 cssselect-1.1.0 lxml-4.5.0 parsel-1.5.2 protego-0.1.16 pyOpenSSL-19.1.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.20 queuelib-1.5.0 scrapy-2.0.0 service-identity-18.1.0 w3lib-1.21.0
最后一步 测试
C:\Users\Big Bang>python
Python 3.7.0 (v3.7.0:1bf9cc5093, Jun 27 2018, 04:59:51) [MSC v.1914 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>>
>>> import scrapy
>>>
成功!