scrapy spider框架download下来就可以用

一.通过命令行创建scrapy项目

1.scrapy startproject project_Spider

二.通过命令行创建spider

1.scrapy genspider firstspider

2.定义需要抓取的字段，在items.py文件中对目标字段进行定义

# Define here the models for your scraped items
#
# See documentation in:
# https://docs.scrapy.org/en/latest/topics/items.html

import scrapy


class ProjectSpiderItem(scrapy.Item):
    # define the fields for your item here like:
    link=scrapy.Field()
    title = scrapy.Field()
    timeDate=scrapy.Field()
    pag