linux里创建pyhone3的scrapy框架

本文更新于2016/11/22
用于在linux里创建pyhone3的scrapy框架，与原来的python2共存

Docker打包镜像：

https://hub.docker.com/r/muchen/ubuntu_scrapy/

0.安装python3

sudo apt-get update
sudo apt-get install python3

1.安装pip3

sudo apt-get install python3-pip
sudo pip3 install --upgrade pip

2.安装lxml

sudo apt-get install python3-lxml

3.安装cryptography

3.1 安装依赖库 (最好sudo)

wget ftp://sourceware.org/pub/libffi/libffi-3.0.11.tar.gz
tar zxvf libffi-3.0.11.tar.gz
cd libffi-3.0.11/
./configure
make
sudo apt-get install build-essential libssl-dev  libffi-dev python-dev

3.2 安装cryptography

自动安装：
sudo pip3 install cryptography

手动安装：
wget http://pypi.python.org/packages/source/c/cryptography/cryptography-0.4.tar.gz
tar zxvf cr*
cd cryptography-0.4
sudo python3 setup.py build
sudo python3 setup.py install

4.更新库

sudo apt-get update
sudo pip3 install -U distribute
sudo pip3 freeze --local | grep -v '^\-e' | cut -d = -f 1  | xargs pip3 install -U

5.安装scrapy

sudo pip3 install scrapy