随机搭建headers池

最新推荐文章于 2024-05-27 15:15:10 发布

风启新尘

最新推荐文章于 2024-05-27 15:15:10 发布

阅读量1.3k

点赞数 8

分类专栏：爬虫 headers web 文章标签： python

本文链接：https://blog.csdn.net/weixin_49265805/article/details/109897980

版权

爬虫同时被 3 个专栏收录

51 篇文章 0 订阅

订阅专栏

headers

5 篇文章 0 订阅

订阅专栏

web

4 篇文章 0 订阅

订阅专栏

import random
from fake_useragent import UserAgent
#第一步批量生成headers
for i in range(20):
    print(UserAgent().random)
#第二步 建立随机headers
user_agent_list = [
    "Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.67 Safari/537.36"
    "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2227.0 Safari/537.36"
    "Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2049.0 Safari/537.36"
    "Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:22.0) Gecko/20130328 Firefox/22.0"
    "Mozilla/5.0 (Windows NT 6.2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/28.0.1464.0 Safari/537.36"
    "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/31.0.1623.0 Safari/537.36"
    "Mozilla/5.0 (Windows NT 6.2; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/32.0.1667.0 Safari/537.36"
    "Mozilla/5.0 (X11; NetBSD) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.116 Safari/537.36"
    "Mozilla/5.0 (Windows NT 5.0; rv:21.0) Gecko/20100101 Firefox/21.0"
    "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/32.0.1664.3 Safari/537.36"
    "Opera/9.80 (Windows NT 5.1; U; cs) Presto/2.7.62 Version/11.01"
    "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1944.0 Safari/537.36"
    "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:21.0) Gecko/20130331 Firefox/21.0"
    "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2227.1 Safari/537.36"
    "Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.67 Safari/537.36"
    "Mozilla/5.0 (Windows NT 10.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/40.0.2214.93 Safari/537.36"
    "Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.67 Safari/537.36"
    "Mozilla/5.0 (X11; OpenBSD i386) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.125 Safari/537.36"
    "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/34.0.1847.137 Safari/4E423F"
    "Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.93 Safari/537.36"
]
headers = {"user-agent": random.choice(user_agent_list)}

#上面的就可以直接运行,也可以下面的判断1
# if headers == None:
#     headers = {"user-agent": random.choice(user_agent_list)}
# else:
#     headers['user-agent'] = random.choice(user_agent_list)
# print(headers)

在这里插入图片描述

刚毕业，应届，同事欺负我，不想说啥，加油自己，努力变强，希望我永远跟海绵宝宝一样快乐

补发一个

import random
import time
from fake_useragent import UserAgent
list=[]
for i in range(200):
    hap=(UserAgent().random)
    list.append(hap)
    headers = {"user-agent": random.choice(list)}