【scrapy 爬虫问题】爬虫文件的parse函数没有执行，求解答

weixin_42847617

已于 2022-07-31 15:17:09 修改

阅读量1k

点赞数

文章标签：爬虫 scrapy python

于 2022-07-29 21:54:19 首次发布

本文链接：https://blog.csdn.net/weixin_42847617/article/details/126064623

版权

scrapy 中的爬虫部分的代码如下：

为什么连print(2)都不打印,实锤没有执行parse;setting文件中的代理也改为谷歌浏览器的了,其他都是默认的

import scrapy
from pachong2.items import MovieItem
from scrapy import Selector

class DoubanSpider(scrapy.Spider):
    name = 'douban'
    allowed_domains = ['movie.douban.com']
    start_urls = ['http://movie.douban.com/top250']

    def parse(self, response):
        print(2)
        sel = Selector(response)
        list_items = sel.css('#content > div > div.article > ol> li')
        print(list_items)
        for list_item in list_items:
            movie_item = MovieItem()
            movie_item['title'] = list_item.css('span.title::text').extract_first()
            movie_item['score'] = list_item.css('class.rating_num::text').extract_first()
        yield movie_item