整个pyspider打包环境下载地址如下
首先确保你安装的是python2.7(32位,因为64位使用pyspider有些bug)
然后安装easy_install(不是必须)
下载地址:https://pypi.python.org/pypi/ez_setup解压easy_install安装包,进入文件夹中,执行python ez_setup.py
同理安装pip
下载地址:https://pypi.python.org/pypi/pip解压pip安装包,进入文件夹中,执行python setup.py install
配置环境变量
指向:C:\Python27\Scripts
安装lxml-2.2.8.win-amd64-py2.7
双击安装即可
下载:https://pypi.python.org/pypi/lxml/2.2.8
如出现Python version 2.7 required, which was not found in the registry
装需要拷贝如下内容到文件register.py(新建到任意位置)中,使用python执行即可
#
# script to register Python 2.0 or later for use with win32all
# and other extensions that require Python registry settings
#
# written by Joakim Loew for Secret Labs AB / PythonWare
#
# source:
# http://www.pythonware.com/products/works/articles/regpy20.htm
#
# modified by Valentine Gogichashvili as described in http://www.mail-archive.com/distutils-sig@python.org/msg10512.html
import sys
from _winreg import *
# tweak as necessary
version = sys.version[:3]
installpath = sys.prefix
regpath = "SOFTWARE\\Python\\Pythoncore\\%s\\" % (version)
installkey = "InstallPath"
pythonkey = "PythonPath"
pythonpath = "%s;%s\\Lib\\;%s\\DLLs\\" % (
installpath, installpath, installpath
)
def RegisterPy():
try:
reg = OpenKey(HKEY_CURRENT_USER, regpath)
except EnvironmentError as e:
try:
reg = CreateKey(HKEY_CURRENT_USER, regpath)
SetValue(reg, installkey, REG_SZ, installpath)
SetValue(reg, pythonkey, REG_SZ, pythonpath)
CloseKey(reg)
except:
print "*** Unable to register!"
return
print "--- Python", version, "is now registered!"
return
if (QueryValue(reg, installkey) == installpath and
QueryValue(reg, pythonkey) == pythonpath):
CloseKey(reg)
print "=== Python", version, "is already registered!"
return
CloseKey(reg)
print "*** Unable to register!"
print "*** You probably have another Python installation!"
if __name__ == "__main__":
RegisterPy()
如不安装,直接跳到下一步安装pyspider会出现如下的问题:
配置phantomjs
把phantomjs.exe拷贝到Python27\Scripts中
安装pyspider
pip install pyspider
启动后台
pyspider all提示错误:
C:\Users\Administrator>pyspider all
Traceback (most recent call last):
File "C:\Python27\Scripts\pyspider-script.py", line 5, in <module>
from pkg_resources import load_entry_point
File "C:\Python27\lib\site-packages\distribute-0.6.14-py2.7.egg\pkg_resources.
py", line 2671, in <module>
working_set.require(__requires__)
File "C:\Python27\lib\site-packages\distribute-0.6.14-py2.7.egg\pkg_resources.
py", line 654, in require
needed = self.resolve(parse_requirements(requirements))
File "C:\Python27\lib\site-packages\distribute-0.6.14-py2.7.egg\pkg_resources.
py", line 552, in resolve
raise DistributionNotFound(req)
pkg_resources.DistributionNotFound: six>=1.5.0
那是因为我们没安装distribute
pip install -U distribute
安装之后可以看到如下信息
在浏览器中配置和查看任务
http://localhost:5000/