项目场景:
使用scrapy爬取猫眼电影的相关信息
问题描述:
项目运行后,红字日志部分出现了下列内容
2021-03-07 12:39:01 [scrapy.downloadermiddlewares.redirect]
DEBUG: Redirecting (302) to <GET https://verify.maoyan.com/
verify?redirectURL=https%3A%2F%2Fmaoyan.com%2Ffilms&requestC
ode=9aab1b3f93a15007eefcd0b6f691c511mllb5> from <GET https:/
/maoyan.com/films?offset=30>
即出现了一个网址,且并没有进行预定的打印操作
https://verify.maoyan.com/verifyredirectURL=https%3A%2F%2Fmaoyan.com%2Ffilms&requestCode=9aab1b3f93a15007eefcd0b6f691c511mllb5
原因分析:
猫眼电影每过一段时间就要重新验证一下,防止频繁操作
解决方案:
进入上述的网址滑动验证即可