Scrapy-fake-useragent

LAN_KINGDOM

已于 2024-07-11 15:08:16 修改

阅读量177

点赞数 2

文章标签： scrapy

于 2024-07-11 15:07:48 首次发布

本文链接：https://blog.csdn.net/qq_39000057/article/details/140352630

版权

pip install scrapy-fake-useragent

DOWNLOADER_MIDDLEWARES = {
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware': None,
'scrapy.downloadermiddlewares.retry.RetryMiddleware': None,
'scrapy_fake_useragent.middleware.RandomUserAgentMiddleware': 400,
'scrapy_fake_useragent.middleware.RetryUserAgentMiddleware': 401,
}