scrapy的项目文件
-
scrapy.cfg
# Automatically created by: scrapy startproject # # For more information about the [deploy] section see: # https://scrapyd.readthedocs.io/en/latest/deploy.html [settings] default = day01.settings [deploy] #url = http://localhost:6800/ project = day01
在里面的settings表示指定的项目设置文件也就是我们的settings.py
这里的deploy表示的是我们的项目部署方面的内容,后续会详细的进行讲解
-
items.py
这个文件主要是用于编写我们的数据是怎么存的,或者说我们要将爬取的数据那些内容存储进去,可以说是定义模型
# Define here the models for your scraped items # # See documentation in: # https://docs.scrapy.org/en/latest/topics/items.html import scrapy class Day01Item(scrapy.Item): # define the fields for your item here like: # name