一、 Scrapy简介
Scrapy is a fast high-level screen scraping and web crawling framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.
二、 安装Python2.7
1)安装python
安装目录:D:\Python27
2)添加环境变量
略System Properties -> Advanced -> Environment Variables - >System Variables -> Path -> Edit
3)验证环境变量
T:\>set Path
Path=C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;D:\Rational\common;D:\Rational\ClearCase\bin;D:\Python27;D:\Python27\Scripts
PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH
4)验证Python
T:\>python
Python 2.7.3 (default, Apr 10 2012, 23:31:26) [MSC v.1500 32 bit (Intel)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> exit()
T:\>
三、 安装Twisted
Twisted is an event-driven networking engine written in Python and licensed under the open source
1)安装setuptools
Download, build, install, upgrade, and uninstall Python packages -- easily!
安装过程:略
2)安装Zope.Interface
安装过程: