Centos6.5安装Scrapy

  1. python -V
  2. yum -y update
  3. yum groupinstall -y development
  4. yum install -y zlib-dev openssl-devel sqlite-devel bzip2-devel
  5. wget https://www.python.org/ftp/python/3.5.2/Python-3.5.2.tar.xz
  6. tar -xvf Python-3.5.2.tar.xz
  7. cd Python-3.5.2
  8. ./configure
  9. make && make install
  10. mv /usr/bin/python /usr/bin/python2.6.6
  11. ln -s /usr/local/bin/python3.5 /usr/bin/python
  12. vi /usr/bin/yum(#!/usr/bin/python 改为 #!/usr/bin/python2.6.6)
  13. wget --no-check-certificate https://pypi.python.org/packages/source/s/setuptools/setuptools-1.4.2.tar.gz
  14. tar -xvf setuptools-1.4.2.tar.gz
  15. cd setuptools-1.4.2
  16. python setup.py install
  17. ln -s /usr/local/bin/easy_install-3.5 /usr/bin/easy_install
  18. easy_install pip
  19. curl https://raw.github.com/pypa/pip/master/contrib/get-pip.py | python3.5
  20. yum -y install libxslt-devel
  21. yum -y install libffi-devel
  22. pip install scrapy
  23. scrapy -h                                                                                                                                                                                                                                                                               Scrapy 1.1.2 - project: tutorial
    Usage:
      scrapy <command> [options] [args]

    Available commands:
      bench         Run quick benchmark test
      check         Check spider contracts
      commands      
      crawl         Run a spider
      edit          Edit spider
      fetch         Fetch a URL using the Scrapy downloader
      genspider     Generate new spider using pre-defined templates
      list          List available spiders
      parse         Parse URL (using its spider) and print the results
      runspider     Run a self-contained spider (without creating a project)
      settings      Get settings values
      shell         Interactive scraping console
      startproject  Create new project
      version       Print Scrapy version
      view          Open URL in browser, as seen by Scrapy

    Use "scrapy <command> -h" to see more info about a command
  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值