Spider之忽略网站SSL证书验证

通过requests请求发起get请求:

1. 未设置忽略验证

import requests
response = requests.get('https://www.12306.cn') #设置忽略SSL验证verify=False
print(response.status_code)

报错, 意思就是该网站没有SSL证验证书, 因为12306.cn是我国自行颁发的证书, 并没有得到国际相关机构的认同:

...
File "/usr/local/lib/python3.6/site-packages/requests/adapters.py", line 506, in send
    raise SSLError(e, request=request)
requests.exceptions.SSLError: HTTPSConnectionPool(host='www.12306.cn', port=443): Max retries exceeded with url: / (Caused by SSLError(CertificateError("hostname 'www.12306.cn' doesn't match either of 'webssl.chinanetcenter.com',
...

2. 设置忽略验证

import requests
from requests import urllib3

urllib3.disable_warnings() #不显示警告信息
response = requests.get('https://www.12306.cn', verify=False) #设置忽略SSL验证verify=False
print(response.status_code)

结果:

200