实用库：Python之伪装浏览器访问fake_useragent库

安装

pip install fake_useragent

实现

from fake_useragent import UserAgent
ua = UserAgent()
for i in range(5):
	print(ua.random)

运行结果：

Mozilla/5.0 (Windows NT 6.2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/28.0.1464.0 Safari/537.36
Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.67 Safari/537.36
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/34.0.1847.137 Safari/4E423F
Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:17.0) Gecko/20100101 Firefox/17.0.6
Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:25.0) Gecko/20100101 Firefox/29.0

会随机使用不同的UserAgent去访问网站。

具体使用

import requests
from fake_useragent import UserAgent
ua = UserAgent()
headers = {'User-Agent':ua.random}
url = '待爬取网页'
r = requests.get(url,headers = headers,timeout = 10)