scrapy
scarpyscarpy debug 模式from scrapy.cmdline import executeimport sysimport ossys.path.append(os.path.dirname(os.path.abspath(__file__)))execute(["scrapy","crawl","jobbole"])settings设置中# Obey robots.txt rulesROBOTSTXT_OBEY = False就可以进行debug...
原创
2020-11-28 20:51:47 ·
100 阅读 ·
0 评论