scrapy实例

1. 创建Scrapy项目

scrapy startproject Tencent

1. 编写item

import scrapy
class TencentItem(scrapy.Item):
    # 职位名
    positionname = scrapy.Field()
    # 详情连接
    positionlink = scrapy.Field()
    # 职位类别
    positionType = scrapy.Field()
    # 招聘人数
    peopleNum = scrapy.Field()
    # 工作地点
    workLocation = scrapy.Field()
    # 发布时间
    publishTime = scrapy.Field()

1. 编写spider文件
   创建spider下的tencentPostion.py文件

scrapy genspider tencentPostion "tencent.com"

1. 执行命令

scrapy crwal tencentPosition

1. 5.