1、具体报错如下:
Traceback (most recent call last):
File "/usr/local/bin/scrapy", line 8, in <module>
sys.exit(execute())
File "/usr/local/lib/python3.5/dist-packages/scrapy/cmdline.py", line 149, in execute
cmd.crawler_process = CrawlerProcess(settings)
File "/usr/local/lib/python3.5/dist-packages/scrapy/crawler.py", line 251, in __init__
super(CrawlerProcess, self).__init__(settings)
File "/usr/local/lib/python3.5/dist-packages/scrapy/crawler.py", line 137, in __init__
self.spider_loader = _get_spider_loader(settings)
File "/usr/local/lib/python3.5/dist-packages/scrapy/crawler.py", line 338, in _get_spider_loader
return loader_cls.from_settings(settings.frozencopy())
File "/usr/local/lib/python3.5/dist-packages/scrapy/spiderloader.py", line 61, in from_settings
return cls(settings)
File "/usr/local/lib/python3.5/dist-packages/scrapy/spiderloader.py", line 25, in __init__
self._load_all_spiders()
File "/usr/local/lib/python3.5/dist-packages/scrapy/spiderloader.py", line 47, in _load_all_spiders
for module in walk_modules(name):
File "/usr/local/lib/python3.5/dist-packages/scrapy/utils/misc.py", line 71, in walk_modules
submod = import_module(fullpath)
File "/usr/lib/python3.5/importlib/__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 986, in _gcd_import
File "<frozen importlib._bootstrap>", line 969, in _find_and_load
File "<frozen importlib._bootstrap>", line 958, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 665, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "/root/SecNew/SecNews/SecNews/spiders/article.py", line 3, in <module>
from scrapy_redis.spiders import RedisSpider
File "/usr/local/lib/python3.5/dist-packages/scrapy_redis/spiders.py", line 117
self.logger.info(f"start req url:{req.url}")
^
SyntaxError: invalid syntax
2、分析:
- 首先查看是否自己编写程序代码错误,
- 其次程序错误代码类型(SyntaxError),显然是语法错误
- 一般语法错误大都是自身程序编写过程中马虎造成的(中英文符号:逗号、双引号、缩进格式、关键字拼写等)
- 若是框架或导入的第三方程序包文件中的语法错误,可能是版本问题,python新版本语法在旧的python环境中不能正常运行
3、本次报错环境(由于某些原因未更新python版本):
- python3.5
- 实际开发使用的是3.7
4、具体报错原因:
- 围绕图中位置展开分析,语法错误
- f" " 是Python3.6新增了一种f-字符串格式化
- 我平时用的字符串格式化是 {url}.format(url)
- 也就是python3.6的功能在python3.5无法执行
5、解决办法:
- 找到文件位置,找到所在行(117行),修改成如下图
vim /usr/local/lib/python3.5/dist-packages/scrapy_redis/spiders.py