参考文档:
http://stackoverflow.com/questions/6504810/how-to-install-lxml-on-ubuntu
好长时间没在本机跑爬虫,今日一跑居然报错
Traceback (most recent call last):
File "/home/yuzx/data/git_st/ad-crawler/adimage_crawler/adimage_crawler/spiders/lady8844_star.py", line 2, in <module>
import scrapy
File "/usr/local/lib/python2.7/dist-packages/scrapy/__init__.py", line 27, in <module>
from . import _monkeypatches
File "/usr/local/lib/python2.7/dist-packages/scrapy/_monkeypatches.py", line 20, in <module>
import twisted.persisted.styles # NOQA
ImportError: No module named persisted.styles
尝试升级以下 scrapy
pip2 install --user scrapy --upgrade
在编译时报错:
src/lxml/includes/etree_defs.h:14:31: fatal error: libxml/xmlversion.h: 没有那个文件或目录
安装依赖
sudo apt-get -y install libxml2-dev libxslt1-dev