解决python爬虫挂代理报错

__hkw__

已于 2022-07-05 08:39:03 修改

阅读量1k

点赞数 2

分类专栏： Python 文章标签： python 爬虫

于 2022-07-04 17:31:43 首次发布

本文链接：https://blog.csdn.net/m0_61005893/article/details/125604935

版权

Python 专栏收录该内容

3 篇文章 0 订阅

订阅专栏

requests.exceptions.SSLError: HTTPSConnectionPool(host='www.youtube.com', port=443): Max retries exceeded with url: / (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:1129)')))

原因

urllib3 1.26更新了主架构

proxy = {
    'https': 'http://127.0.0.1:7890',
}

# urllib3 schema旧版
proxies ={
    'http':'http://127.0.0.1:7890',
    'https':'https://127.0.0.1:7890'
}

解决方法一：

pip install --upgrade pip
pip install urllib3==1.25.11

解决方法二：

# proxy换成urllib3 1.26格式

import requests

url = 'https://www.youtube.com/'
proxy = {
    'https': 'http://127.0.0.1:7890',
}
headers = {
    'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36'
}
res = requests.get(url=url, headers=headers, proxies=proxy)
print(res.text)