爬虫
风萧萧兮易水寒!
生活无奈啊
展开
-
Scrapy github模拟登陆
1、 创建项目scrapy startproject GitHub2、创建爬虫scrapy genspider github github.com3、编辑github.py:# -*- coding: utf-8 -*-import scrapyfrom scrapy import Request, FormRequestclass GithubSpider(scr...转载 2019-03-01 15:05:57 · 380 阅读 · 0 评论 -
scrapy 模拟登陆 并且爬取51cto 文章
a51cto.py# -*- coding: utf-8 -*-import scrapyfrom scrapy.http import FormRequestfrom cto.items import CtospiderItemclass CtoSpider(scrapy.Spider): name = '51cto' allowed_domains = ['5...转载 2019-03-02 10:08:09 · 342 阅读 · 0 评论