安装Scrapy过程中遇到的几个问题总结

安装Scrapy首先需要安装pip

但是在安装pip的过程中,提示需要安装setuptools     

然后下载setuptools的安装包,执行easy_install的过程中报错,缺少zlib模块

RuntimeError: Compression requires the (missing) zlib module

需要下载安装zlib

yum install zlib

yum install zlib-devl

然后重新编译安装python

make

make install

重新安装setuptools     python easy_install.py install

安装pip报错

报错

pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available.
Collecting lxml
  Could not fetch URL https://pypi.python.org/simple/lxml/: There was a problem confirming the ssl certificate: Can't connect to HTTPS URL because the SSL module is not available. - skipping
  Could not find a version that satisfies the requirement lxml (from versions: )
No matching distribution found for lxml

原因是没有安装openssl

yum install openssl

 yum install openssl-devel -y 

rpm -qa|grep openssl

重新编译安装python

安装Scrapy   报错

Could not find a version that satisfies the requirement Twisted>=13.1.0 (from Scrapy) (from versions: )
No matching distribution found for Twisted>=13.1.0 (from Scrapy)

原因是没有安装Twisted

wget https://pypi.python.org/packages/source/T/Twisted/Twisted-15.2.1.tar.bz2

tar -xjvf Twisted-15.2.1.tar.bz2
cd Twisted-15.2.1
python setup.py install

成功