运行scrapy 报错ERROR: Spider error processing )

运行scrapy 报错ERROR: Spider error processing )

##运行scrapy 报错ERROR: Spider error processing GEThttp://www.chinacar.com.cn/Hod/ODk2MTkz (referer: None)
Traceback (most recent call last):
File “C:\Users\Administrator.conda\envs\projects\Lib\site-packages\scrapy\utils\defer.py”, line 73, in mustbe_deferred
…
File “C:\Users\Administrator.conda\envs\projects\Lib\inspect.py”, line 1081, in findsource
raise OSError(‘could not get source code’)
OSError: could not get source code

查看编码是否为UTF-8

这个有一点点作用

查看请求头

主要是因为请求头的原因，设置settings文件下的请求头问题基本就解决了

DEFAULT_REQUEST_HEADERS = {
   # "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8",
    'Accept': 'application/x-json;text/x-json;charset=utf-8',
   # "Accept-Language": "en",
    'Accept-Language':'zh-CN,zh;q=0.9',
    'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/119.0 Safari/537.36',

}

设置完如果还不可以，建议可以重新构建一个spiders，问题就解决了。