说明:
使用官方示例进行多个spider顺序执行时,程序卡住了:
Common Practices — Scrapy 2.7.1 documentation
解决办法:
默认生成的settings.py文件中,最下面几行可看到
# Set settings whose default value is deprecated to a future-proof value
REQUEST_FINGERPRINTER_IMPLEMENTATION = '2.7'
TWISTED_REACTOR = 'twisted.internet.asyncioreactor.AsyncioSelectorReactor'
将TWISTED_REACTOR = 'twisted.internet.asyncioreactor.AsyncioSelectorReactor' 这行删去