背景:
Windows 环境下,爬虫在爬取过程中使用selenium IEdriver爬取,IEdriver设置了代理,这个代理是系统代理。此时使用requests 怎么避免使用系统代理?
解决方案:
1. 指定域名不使用代理
import os
import requests
os.environ['NO_PROXY'] = 'stackoverflow.com'
response = requests.get('http://www.stackoverflow.com')
2. 设置代理为None
import requests
proxies = {
"http": None,
"https": None,
}
requests.get("http://example.org", proxies=proxies)
3. 设置trust_env = False
import requests
session = requests.Session()
session.trust_env = False
response = session.get('http://www.stackoverflow.com')
https://stackoverflow.com/questions/28521535/requests-how-to-disable-bypass-proxy