参考网址:https://scrapy-chs.readthedocs.io/zh_CN/0.24/intro/tutorial.html
1.下载scrapy
2.创建项目
scrapy startproject tutorial
scrapy genspider zhidao www.baidu.com
3.定义item
class DmozItem(scrapy.Item):
title = scrapy.Field()
link = scrapy.Field()
desc = scrapy.Field()
4.编写爬虫
5.启动蜘蛛
scrapy crawl dmoz