installation guide 研读

scrapy支持python2.7和python3.3以上版本,在windows下不支持python3版本(目前不支持)

官方建议安装scrapy在虚拟环境中(virtualenv)

Scrapy is written in pure Python and depends on a few key Python packages (among others):
    lxml, an efficient XML and HTML parser
    parsel, an HTML/XML data extraction library written on top of lxml,
    w3lib, a multi-purpose helper for dealing with URLs and web page encodings
    twisted, an asynchronous networking framework
    cryptography and pyOpenSSL, to deal with various network-level security needs

安装scrapy前需要安装下列依赖:
	sudo apt-get install python-dev python-pip libxml2-dev libxslt1-dev zlib1g-dev libffi-dev libssl-dev

如果想安装在python3版本中,还需要加上下列命令:
	sudo apt-get install python3 python3-dev

python-dev, zlib1g-dev, libxml2-dev and libxslt1-dev are required for lxml
libssl-dev and libffi-dev are required for cryptography

Anaconda(一个科学计算的工具):
Using Anaconda is an alternative to using a virtualenv and installing with pip.
To install Scrapy using conda, run:
	conda install -c conda-forge scrapy


  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值