2021-11-14

艰难安装pyspider

环境:WIN10,python3.6.

这个pyspider搞了我两天终于安装好了。

1.首先把安装好的库全部删除


```python
pip freeze > allpackages.txt
pip uninstall -r allpackages.txt -y


## 功能快捷键

```python
Microsoft Windows [版本 10.0.18362.1256]
(c) 2019 Microsoft Corporation。保留所有权利。

C:\WINDOWS\system32>pip freeze > allpackages.txt

C:\WINDOWS\system32>pip uninstall -r allpackages.txt -y
Found existing installation: certifi 2021.10.8
Uninstalling certifi-2021.10.8:
  Successfully uninstalled certifi-2021.10.8
Found existing installation: chardet 4.0.0
Uninstalling chardet-4.0.0:
  Successfully uninstalled chardet-4.0.0
Found existing installation: charset-normalizer 2.0.7
Uninstalling charset-normalizer-2.0.7:
  Successfully uninstalled charset-normalizer-2.0.7
Found existing installation: click 8.0.3
Uninstalling click-8.0.3:
  Successfully uninstalled click-8.0.3
Found existing installation: colorama 0.4.4
Uninstalling colorama-0.4.4:
  Successfully uninstalled colorama-0.4.4
Found existing installation: cssselect 1.1.0
Uninstalling cssselect-1.1.0:
  Successfully uninstalled cssselect-1.1.0
Found existing installation: dataclasses 0.8
Uninstalling dataclasses-0.8:
  Successfully uninstalled dataclasses-0.8
Found existing installation: defusedxml 0.7.1
Uninstalling defusedxml-0.7.1:
  Successfully uninstalled defusedxml-0.7.1
Found existing installation: Flask 1.1.1
Uninstalling Flask-1.1.1:
  Successfully uninstalled Flask-1.1.1
Found existing installation: Flask-Login 0.5.0
Uninstalling Flask-Login-0.5.0:
  Successfully uninstalled Flask-Login-0.5.0
Found existing installation: idna 3.3
Uninstalling idna-3.3:
  Successfully uninstalled idna-3.3
Found existing installation: importlib-metadata 4.8.2
Uninstalling importlib-metadata-4.8.2:
  Successfully uninstalled importlib-metadata-4.8.2
Found existing installation: itsdangerous 2.0.1
Uninstalling itsdangerous-2.0.1:
  Successfully uninstalled itsdangerous-2.0.1
Found existing installation: Jinja2 3.0.3
Uninstalling Jinja2-3.0.3:
  Successfully uninstalled Jinja2-3.0.3
Found existing installation: json5 0.9.6
Uninstalling json5-0.9.6:
  Successfully uninstalled json5-0.9.6
Found existing installation: lxml 4.6.4
Uninstalling lxml-4.6.4:
  Successfully uninstalled lxml-4.6.4
Found existing installation: MarkupSafe 2.0.1
Uninstalling MarkupSafe-2.0.1:
  Successfully uninstalled MarkupSafe-2.0.1
Found existing installation: pycurl 7.43.0.5
Uninstalling pycurl-7.43.0.5:
  Successfully uninstalled pycurl-7.43.0.5
Found existing installation: pyquery 1.4.3
Uninstalling pyquery-1.4.3:
  Successfully uninstalled pyquery-1.4.3
Found existing installation: pyspider 0.3.10
Uninstalling pyspider-0.3.10:
  Successfully uninstalled pyspider-0.3.10
Found existing installation: PyYAML 6.0
Uninstalling PyYAML-6.0:
  Successfully uninstalled PyYAML-6.0
Found existing installation: requests 2.26.0
Uninstalling requests-2.26.0:
  Successfully uninstalled requests-2.26.0
Found existing installation: six 1.16.0
Uninstalling six-1.16.0:
  Successfully uninstalled six-1.16.0
Found existing installation: tblib 1.7.0
Uninstalling tblib-1.7.0:
  Successfully uninstalled tblib-1.7.0
Found existing installation: tornado 4.5.3
Uninstalling tornado-4.5.3:
  Successfully uninstalled tornado-4.5.3
Found existing installation: typing-extensions 3.10.0.2
Uninstalling typing-extensions-3.10.0.2:
  Successfully uninstalled typing-extensions-3.10.0.2
Found existing installation: u-msgpack-python 2.7.1
Uninstalling u-msgpack-python-2.7.1:
  Successfully uninstalled u-msgpack-python-2.7.1
Found existing installation: urllib3 1.26.7
Uninstalling urllib3-1.26.7:
  Successfully uninstalled urllib3-1.26.7
Found existing installation: Werkzeug 0.16.0
Uninstalling Werkzeug-0.16.0:
  Successfully uninstalled Werkzeug-0.16.0
Found existing installation: WsgiDAV 3.1.1
Uninstalling WsgiDAV-3.1.1:
  Successfully uninstalled WsgiDAV-3.1.1
Found existing installation: zipp 3.6.0
Uninstalling zipp-3.6.0:
  Successfully uninstalled zipp-3.6.0

C:\WINDOWS\system32>pip list
Package    Version
---------- -------
pip        21.3.1
setuptools 39.0.1

C:\WINDOWS\system32>pip install redis
Collecting redis
  Using cached redis-3.5.3-py2.py3-none-any.whl (72 kB)
Installing collected packages: redis
Successfully installed redis-3.5.3

C:\WINDOWS\system32>pip install pyspider
Collecting pyspider
  Using cached pyspider-0.3.10.tar.gz (110 kB)
  Preparing metadata (setup.py) ... done
Collecting Flask>=0.10
  Using cached Flask-2.0.2-py3-none-any.whl (95 kB)
Collecting Jinja2>=2.7
  Using cached Jinja2-3.0.3-py3-none-any.whl (133 kB)
Collecting chardet>=2.2
  Using cached chardet-4.0.0-py2.py3-none-any.whl (178 kB)
Collecting cssselect>=0.9
  Using cached cssselect-1.1.0-py2.py3-none-any.whl (16 kB)
Collecting lxml
  Using cached lxml-4.6.4-cp36-cp36m-win_amd64.whl (3.5 MB)
Collecting pycurl
  Using cached pycurl-7.44.1.tar.gz (227 kB)
  Preparing metadata (setup.py) ... error
  ERROR: Command errored out with exit status 10:
   command: 'c:\python36\python.exe' -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\pip-install-od5xf9pg\\pycurl_74ff19b3fc4a46a698100a7ab5b4966b\\setup.py'"'"'; __file__='"'"'C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\pip-install-od5xf9pg\\pycurl_74ff19b3fc4a46a698100a7ab5b4966b\\setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base 'C:\Users\ADMINI~1\AppData\Local\Temp\pip-pip-egg-info-o5q4ji9k'
       cwd: C:\Users\ADMINI~1\AppData\Local\Temp\pip-install-od5xf9pg\pycurl_74ff19b3fc4a46a698100a7ab5b4966b\
  Complete output (1 lines):
  Please specify --curl-dir=/path/to/built/libcurl
  ----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/47/f9/c41d6830f7bd4e70d5726d26f8564538d08ca3a7ac3db98b325f94cdcb7f/pycurl-7.44.1.tar.gz#sha256=5bcef4d988b74b99653602101e17d8401338d596b9234d263c728a0c3df003e8 (from https://pypi.org/simple/pycurl/) (requires-python:>=3.5). Command errored out with exit status 10: python setup.py egg_info Check the logs for full command output.
  Using cached pycurl-7.44.0.tar.gz (227 kB)
  Preparing metadata (setup.py) ... error
  ERROR: Command errored out with exit status 10:
   command: 'c:\python36\python.exe' -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\pip-install-od5xf9pg\\pycurl_6ef43aa1f0ee4b939b0510b3ceedd4c7\\setup.py'"'"'; __file__='"'"'C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\pip-install-od5xf9pg\\pycurl_6ef43aa1f0ee4b939b0510b3ceedd4c7\\setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base 'C:\Users\ADMINI~1\AppData\Local\Temp\pip-pip-egg-info-lsay5eyz'
       cwd: C:\Users\ADMINI~1\AppData\Local\Temp\pip-install-od5xf9pg\pycurl_6ef43aa1f0ee4b939b0510b3ceedd4c7\
  Complete output (1 lines):
  Please specify --curl-dir=/path/to/built/libcurl
  ----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/0f/db/856a430445d6cd631a7c97f028e3a9d947f84a1a27c42b5d47245eae920e/pycurl-7.44.0.tar.gz#sha256=2ce9905626d8ceafcbadee666e2f45397e29c7618ddcdc63fc22d85e5046c6d6 (from https://pypi.org/simple/pycurl/) (requires-python:>=3.5). Command errored out with exit status 10: python setup.py egg_info Check the logs for full command output.
  Using cached pycurl-7.43.0.6.tar.gz (222 kB)
  Preparing metadata (setup.py) ... error
  ERROR: Command errored out with exit status 10:
   command: 'c:\python36\python.exe' -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\pip-install-od5xf9pg\\pycurl_9ac24d9650f7498a8357325c3d81df21\\setup.py'"'"'; __file__='"'"'C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\pip-install-od5xf9pg\\pycurl_9ac24d9650f7498a8357325c3d81df21\\setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base 'C:\Users\ADMINI~1\AppData\Local\Temp\pip-pip-egg-info-4mmvcati'
       cwd: C:\Users\ADMINI~1\AppData\Local\Temp\pip-install-od5xf9pg\pycurl_9ac24d9650f7498a8357325c3d81df21\
  Complete output (1 lines):
  Please specify --curl-dir=/path/to/built/libcurl
  ----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/50/1a/35b1d8b8e4e23a234f1b17a8a40299fd550940b16866c9a1f2d47a04b969/pycurl-7.43.0.6.tar.gz#sha256=8301518689daefa53726b59ded6b48f33751c383cf987b0ccfbbc4ed40281325 (from https://pypi.org/simple/pycurl/) (requires-python:>=3.5). Command errored out with exit status 10: python setup.py egg_info Check the logs for full command output.
  Using cached pycurl-7.43.0.5-cp36-cp36m-win_amd64.whl (1.7 MB)
Collecting requests>=2.2
  Using cached requests-2.26.0-py2.py3-none-any.whl (62 kB)
Collecting Flask-Login>=0.2.11
  Using cached Flask_Login-0.5.0-py2.py3-none-any.whl (16 kB)
Collecting u-msgpack-python>=1.6
  Using cached u_msgpack_python-2.7.1-py2.py3-none-any.whl (10.0 kB)
Collecting click>=3.3
  Using cached click-8.0.3-py3-none-any.whl (97 kB)
Collecting six>=1.5.0
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting tblib>=1.3.0
  Using cached tblib-1.7.0-py2.py3-none-any.whl (12 kB)
Collecting wsgidav>=2.0.0
  Using cached WsgiDAV-3.1.1-py2.py3-none-any.whl (180 kB)
Collecting tornado<=4.5.3,>=3.2
  Using cached tornado-4.5.3-cp36-cp36m-win_amd64.whl (423 kB)
Collecting pyquery
  Using cached pyquery-1.4.3-py3-none-any.whl (22 kB)
Collecting colorama
  Using cached colorama-0.4.4-py2.py3-none-any.whl (16 kB)
Collecting importlib-metadata
  Using cached importlib_metadata-4.8.2-py3-none-any.whl (17 kB)
Collecting itsdangerous>=2.0
  Using cached itsdangerous-2.0.1-py3-none-any.whl (18 kB)
Collecting Werkzeug>=2.0
  Using cached Werkzeug-2.0.2-py3-none-any.whl (288 kB)
Collecting MarkupSafe>=2.0
  Using cached MarkupSafe-2.0.1-cp36-cp36m-win_amd64.whl (14 kB)
Collecting certifi>=2017.4.17
  Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
  Using cached charset_normalizer-2.0.7-py3-none-any.whl (38 kB)
Collecting idna<4,>=2.5
  Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
  Using cached urllib3-1.26.7-py2.py3-none-any.whl (138 kB)
Collecting json5
  Using cached json5-0.9.6-py2.py3-none-any.whl (18 kB)
Collecting defusedxml
  Using cached defusedxml-0.7.1-py2.py3-none-any.whl (25 kB)
Collecting PyYAML
  Using cached PyYAML-6.0-cp36-cp36m-win_amd64.whl (153 kB)
Collecting dataclasses
  Using cached dataclasses-0.8-py3-none-any.whl (19 kB)
Collecting zipp>=0.5
  Using cached zipp-3.6.0-py3-none-any.whl (5.3 kB)
Collecting typing-extensions>=3.6.4
  Using cached typing_extensions-3.10.0.2-py3-none-any.whl (26 kB)
Using legacy 'setup.py install' for pyspider, since package 'wheel' is not installed.
Installing collected packages: zipp, typing-extensions, MarkupSafe, importlib-metadata, dataclasses, colorama, Werkzeug, Jinja2, itsdangerous, click, urllib3, six, PyYAML, lxml, json5, idna, Flask, defusedxml, cssselect, charset-normalizer, certifi, wsgidav, u-msgpack-python, tornado, tblib, requests, pyquery, pycurl, Flask-Login, chardet, pyspider
    Running setup.py install for pyspider ... done
Successfully installed Flask-2.0.2 Flask-Login-0.5.0 Jinja2-3.0.3 MarkupSafe-2.0.1 PyYAML-6.0 Werkzeug-2.0.2 certifi-2021.10.8 chardet-4.0.0 charset-normalizer-2.0.7 click-8.0.3 colorama-0.4.4 cssselect-1.1.0 dataclasses-0.8 defusedxml-0.7.1 idna-3.3 importlib-metadata-4.8.2 itsdangerous-2.0.1 json5-0.9.6 lxml-4.6.4 pycurl-7.43.0.5 pyquery-1.4.3 pyspider-0.3.10 requests-2.26.0 six-1.16.0 tblib-1.7.0 tornado-4.5.3 typing-extensions-3.10.0.2 u-msgpack-python-2.7.1 urllib3-1.26.7 wsgidav-3.1.1 zipp-3.6.0

C:\WINDOWS\system32>pyspider all
c:\python36\lib\site-packages\pyspider\libs\utils.py:196: FutureWarning: timeout is not supported on your platform.
  warnings.warn("timeout is not supported on your platform.", FutureWarning)
phantomjs fetcher running on port 25555
[I 211114 22:54:27 result_worker:49] result_worker starting...
[I 211114 22:54:27 processor:211] processor starting...
[I 211114 22:54:27 scheduler:647] scheduler starting...
[I 211114 22:54:27 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
[I 211114 22:54:29 scheduler:782] scheduler.xmlrpc listening on 127.0.0.1:23333
[I 211114 22:54:29 tornado_fetcher:638] fetcher starting...
[I 211114 22:54:31 run:420] phantomjs exited.
[I 211114 22:54:31 tornado_fetcher:671] fetcher exiting...
[I 211114 22:54:31 app:84] webui exiting...
[I 211114 22:54:31 result_worker:66] result_worker exiting...
[I 211114 22:54:31 scheduler:663] scheduler exiting...
[I 211114 22:54:31 processor:229] processor exiting...
Traceback (most recent call last):
  File "C:\Python36\Scripts\pyspider-script.py", line 11, in <module>
    load_entry_point('pyspider==0.3.10', 'console_scripts', 'pyspider')()
  File "c:\python36\lib\site-packages\pyspider\run.py", line 754, in main
    cli()
  File "c:\python36\lib\site-packages\click\core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
  File "c:\python36\lib\site-packages\click\core.py", line 1053, in main
    rv = self.invoke(ctx)
  File "c:\python36\lib\site-packages\click\core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "c:\python36\lib\site-packages\click\core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "c:\python36\lib\site-packages\click\core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "c:\python36\lib\site-packages\click\decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "c:\python36\lib\site-packages\pyspider\run.py", line 497, in all
    ctx.invoke(webui, **webui_config)
  File "c:\python36\lib\site-packages\click\core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "c:\python36\lib\site-packages\click\decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "c:\python36\lib\site-packages\pyspider\run.py", line 384, in webui
    app.run(host=host, port=port)
  File "c:\python36\lib\site-packages\pyspider\webui\app.py", line 59, in run
    from .webdav import dav_app
  File "c:\python36\lib\site-packages\pyspider\webui\webdav.py", line 216, in <module>
    dav_app = WsgiDAVApp(config)
  File "c:\python36\lib\site-packages\wsgidav\wsgidav_app.py", line 133, in __init__
    _check_config(config)
  File "c:\python36\lib\site-packages\wsgidav\wsgidav_app.py", line 117, in _check_config
    raise ValueError("Invalid configuration:\n  - " + "\n  - ".join(errors))
ValueError: Invalid configuration:
  - Deprecated option 'domaincontroller': use 'http_authenticator.domain_controller' instead.

C:\WINDOWS\system32>pyspider all
c:\python36\lib\site-packages\pyspider\libs\utils.py:196: FutureWarning: timeout is not supported on your platform.
  warnings.warn("timeout is not supported on your platform.", FutureWarning)
phantomjs fetcher running on port 25555
[I 211114 22:56:01 result_worker:49] result_worker starting...
[I 211114 22:56:01 processor:211] processor starting...
[I 211114 22:56:01 scheduler:647] scheduler starting...
[I 211114 22:56:01 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
[I 211114 22:56:02 scheduler:782] scheduler.xmlrpc listening on 127.0.0.1:23333
[I 211114 22:56:03 tornado_fetcher:638] fetcher starting...
[I 211114 22:56:05 run:420] phantomjs exited.
[I 211114 22:56:05 app:84] webui exiting...
[I 211114 22:56:05 tornado_fetcher:671] fetcher exiting...
[I 211114 22:56:05 scheduler:663] scheduler exiting...
[I 211114 22:56:05 result_worker:66] result_worker exiting...
[I 211114 22:56:05 processor:229] processor exiting...
Traceback (most recent call last):
  File "C:\Python36\Scripts\pyspider-script.py", line 11, in <module>
    load_entry_point('pyspider==0.3.10', 'console_scripts', 'pyspider')()
  File "c:\python36\lib\site-packages\pyspider\run.py", line 754, in main
    cli()
  File "c:\python36\lib\site-packages\click\core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
  File "c:\python36\lib\site-packages\click\core.py", line 1053, in main
    rv = self.invoke(ctx)
  File "c:\python36\lib\site-packages\click\core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "c:\python36\lib\site-packages\click\core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "c:\python36\lib\site-packages\click\core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "c:\python36\lib\site-packages\click\decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "c:\python36\lib\site-packages\pyspider\run.py", line 497, in all
    ctx.invoke(webui, **webui_config)
  File "c:\python36\lib\site-packages\click\core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "c:\python36\lib\site-packages\click\decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "c:\python36\lib\site-packages\pyspider\run.py", line 384, in webui
    app.run(host=host, port=port)
  File "c:\python36\lib\site-packages\pyspider\webui\app.py", line 64, in run
    from werkzeug.wsgi import DispatcherMiddleware
ImportError: cannot import name 'DispatcherMiddleware'

C:\WINDOWS\system32>pip list
Package            Version
------------------ ---------
certifi            2021.10.8
chardet            4.0.0
charset-normalizer 2.0.7
click              8.0.3
colorama           0.4.4
cssselect          1.1.0
dataclasses        0.8
defusedxml         0.7.1
Flask              2.0.2
Flask-Login        0.5.0
idna               3.3
importlib-metadata 4.8.2
itsdangerous       2.0.1
Jinja2             3.0.3
json5              0.9.6
lxml               4.6.4
MarkupSafe         2.0.1
pip                21.3.1
pycurl             7.43.0.5
pyquery            1.4.3
pyspider           0.3.10
PyYAML             6.0
redis              3.5.3
requests           2.26.0
setuptools         39.0.1
six                1.16.0
tblib              1.7.0
tornado            4.5.3
typing-extensions  3.10.0.2
u-msgpack-python   2.7.1
urllib3            1.26.7
Werkzeug           2.0.2
WsgiDAV            3.1.1
zipp               3.6.0

C:\WINDOWS\system32>pip uninstall Flask
Found existing installation: Flask 2.0.2
Uninstalling Flask-2.0.2:
  Would remove:
    c:\python36\lib\site-packages\flask-2.0.2.dist-info\*
    c:\python36\lib\site-packages\flask\*
    c:\python36\scripts\flask.exe
Proceed (Y/n)? y
  Successfully uninstalled Flask-2.0.2

C:\WINDOWS\system32>pip install Flask==1.0.1
Collecting Flask==1.0.1
  Downloading Flask-1.0.1-py2.py3-none-any.whl (91 kB)
     |████████████████████████████████| 91 kB 1.1 MB/s
Requirement already satisfied: itsdangerous>=0.24 in c:\python36\lib\site-packages (from Flask==1.0.1) (2.0.1)
Requirement already satisfied: Jinja2>=2.10 in c:\python36\lib\site-packages (from Flask==1.0.1) (3.0.3)
Requirement already satisfied: click>=5.1 in c:\python36\lib\site-packages (from Flask==1.0.1) (8.0.3)
Requirement already satisfied: Werkzeug>=0.14 in c:\python36\lib\site-packages (from Flask==1.0.1) (2.0.2)
Requirement already satisfied: colorama in c:\python36\lib\site-packages (from click>=5.1->Flask==1.0.1) (0.4.4)
Requirement already satisfied: importlib-metadata in c:\python36\lib\site-packages (from click>=5.1->Flask==1.0.1) (4.8.2)
Requirement already satisfied: MarkupSafe>=2.0 in c:\python36\lib\site-packages (from Jinja2>=2.10->Flask==1.0.1) (2.0.1)
Requirement already satisfied: dataclasses in c:\python36\lib\site-packages (from Werkzeug>=0.14->Flask==1.0.1) (0.8)
Requirement already satisfied: zipp>=0.5 in c:\python36\lib\site-packages (from importlib-metadata->click>=5.1->Flask==1.0.1) (3.6.0)
Requirement already satisfied: typing-extensions>=3.6.4 in c:\python36\lib\site-packages (from importlib-metadata->click>=5.1->Flask==1.0.1) (3.10.0.2)
Installing collected packages: Flask
Successfully installed Flask-1.0.1

C:\WINDOWS\system32>pyspider all
c:\python36\lib\site-packages\pyspider\libs\utils.py:196: FutureWarning: timeout is not supported on your platform.
  warnings.warn("timeout is not supported on your platform.", FutureWarning)
phantomjs fetcher running on port 25555
[I 211114 22:58:12 result_worker:49] result_worker starting...
[I 211114 22:58:12 processor:211] processor starting...
[I 211114 22:58:12 scheduler:647] scheduler starting...
[I 211114 22:58:12 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
[I 211114 22:58:14 scheduler:782] scheduler.xmlrpc listening on 127.0.0.1:23333
[I 211114 22:58:14 tornado_fetcher:638] fetcher starting...
[I 211114 22:58:16 run:420] phantomjs exited.
[I 211114 22:58:16 tornado_fetcher:671] fetcher exiting...
[I 211114 22:58:16 app:84] webui exiting...
[I 211114 22:58:16 scheduler:663] scheduler exiting...
[I 211114 22:58:16 processor:229] processor exiting...
[I 211114 22:58:17 result_worker:66] result_worker exiting...
Traceback (most recent call last):
  File "C:\Python36\Scripts\pyspider-script.py", line 11, in <module>
    load_entry_point('pyspider==0.3.10', 'console_scripts', 'pyspider')()
  File "c:\python36\lib\site-packages\pyspider\run.py", line 754, in main
    cli()
  File "c:\python36\lib\site-packages\click\core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
  File "c:\python36\lib\site-packages\click\core.py", line 1053, in main
    rv = self.invoke(ctx)
  File "c:\python36\lib\site-packages\click\core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "c:\python36\lib\site-packages\click\core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "c:\python36\lib\site-packages\click\core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "c:\python36\lib\site-packages\click\decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "c:\python36\lib\site-packages\pyspider\run.py", line 497, in all
    ctx.invoke(webui, **webui_config)
  File "c:\python36\lib\site-packages\click\core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "c:\python36\lib\site-packages\click\decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "c:\python36\lib\site-packages\pyspider\run.py", line 384, in webui
    app.run(host=host, port=port)
  File "c:\python36\lib\site-packages\pyspider\webui\app.py", line 64, in run
    from werkzeug.wsgi import DispatcherMiddleware
ImportError: cannot import name 'DispatcherMiddleware'

C:\WINDOWS\system32>#卸载
'#卸载' 不是内部或外部命令,也不是可运行的程序
或批处理文件。

C:\WINDOWS\system32>python -m pip uninstall werkzeug
Found existing installation: Werkzeug 2.0.2
Uninstalling Werkzeug-2.0.2:
  Would remove:
    c:\python36\lib\site-packages\werkzeug-2.0.2.dist-info\*
    c:\python36\lib\site-packages\werkzeug\*
Proceed (Y/n)? #安装指定版本
Your response ('#安装指定版本') was not one of the expected responses: y, n,
Proceed (Y/n)? python -m pip install werkzeug==0.16.0
Your response ('python -m pip install werkzeug==0.16.0') was not one of the expected responses: y, n,
Proceed (Y/n)?  y
  Successfully uninstalled Werkzeug-2.0.2

C:\WINDOWS\system32>python -m pip install werkzeug==0.16.0
Collecting werkzeug==0.16.0
  Using cached Werkzeug-0.16.0-py2.py3-none-any.whl (327 kB)
Installing collected packages: werkzeug
Successfully installed werkzeug-0.16.0

C:\WINDOWS\system32>pyspider all
c:\python36\lib\site-packages\pyspider\libs\utils.py:196: FutureWarning: timeout is not supported on your platform.
  warnings.warn("timeout is not supported on your platform.", FutureWarning)
phantomjs fetcher running on port 25555
[I 211114 22:59:18 result_worker:49] result_worker starting...
[I 211114 22:59:19 processor:211] processor starting...
[I 211114 22:59:19 scheduler:647] scheduler starting...
[I 211114 22:59:19 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
[I 211114 22:59:20 scheduler:782] scheduler.xmlrpc listening on 127.0.0.1:23333
[I 211114 22:59:21 tornado_fetcher:638] fetcher starting...
[I 211114 22:59:23 app:76] webui running on 0.0.0.0:5000
[I 211114 23:00:19 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
[I 211114 23:01:19 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
[I 211114 23:02:19 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值