![](https://img-blog.csdnimg.cn/20201014180756923.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
爬虫
风萧萧兮易水寒!
生活无奈啊
展开
-
Scrapy github模拟登陆
1、 创建项目 scrapy startproject GitHub 2、创建爬虫 scrapy genspider github github.com 3、编辑github.py: # -*- coding: utf-8 -*- import scrapy from scrapy import Request, FormRequest class GithubSpider(scr...转载 2019-03-01 15:05:57 · 347 阅读 · 0 评论 -
scrapy 模拟登陆 并且爬取51cto 文章
a51cto.py # -*- coding: utf-8 -*- import scrapy from scrapy.http import FormRequest from cto.items import CtospiderItem class CtoSpider(scrapy.Spider): name = '51cto' allowed_domains = ['5...转载 2019-03-02 10:08:09 · 315 阅读 · 0 评论