request类的各种ERROR

最新推荐文章于 2023-12-12 10:56:02 发布

羊城迷鹿

最新推荐文章于 2023-12-12 10:56:02 发布

阅读量1w

点赞数

分类专栏：爬虫

本文为博主原创文章，未经博主允许不得转载，听见没。

本文链接：https://blog.csdn.net/jining11/article/details/103931486

版权

爬虫专栏收录该内容

16 篇文章 0 订阅

订阅专栏

文章目录

URLerror

URLError类继承自OSError类，是urllib库的error模块的基类，由request操作产生的异常都可以通过捕获该类来处理。它具有一个属性reason，即返回错误的原因。

打开一个不存在的页面

from urllib.request import *
from urllib.error import *
try:
    response = urlopen('https://www.zhihu.com/people/happy233333')
except URLError as e:
    print(e.reason)

Not Found

from urllib.request import *
from urllib.error import *
try:
     response = urlopen("https://qq.123.com")
except URLError as e:
    print(e.reason)

[Errno 11001] getaddrinfo failed

from urllib.request import *
from urllib.error import *
try:
     response = urlopen("https://www.google.com")
except URLError as e:
    print(e.reason)

[Errno 11003] getaddrinfo failed

上面的三个测试，第一个是访问存在的知乎网站+不存在的博客名，第二个是访问不存在的网站。第三个是访问长城之外的网站。

URLError有时候也会是对象

import socket
try:
    response = urlopen('https://www.zhihu.com', timeout=0.01)
except URLError as e:
    print(type(e.reason))
    if isinstance(e.reason, socket.timeout):
        print('time out')

<class 'socket.timeout'>
time out

HTTPError

它是URLError的子类，专门用来请求HTTP请求错误，包含code， reason和headers三个属性。

from urllib.request import *
from urllib.error import *
try:
    response = urlopen('https://www.zhihu.com/people/happy233333')
except HTTPError as e:
    print(e.reason)
    print(e.code)
    print(e.headers)
# 先判断子类error，再判断父类error，符合包含关系
except URLError as e:
    print(e.reason)
else:
    print('everything ok')

Not Found
404
Server: Tengine
Content-Type: text/plain; charset=utf-8
Content-Length: 9
Connection: close
Date: Mon, 06 Jan 2020 14:38:57 GMT
0: cache-control
0: no-cache, no-store, must-revalidate, private, max-age=0
1: connection
1: close
2: content-length
2: 87
3: content-type
3: application/json
4: date
4: Mon, 06 Jan 2020 14:38:57 GMT
5: expires
5: Thu, 01 Jan 1970 08:00:00 CST
6: pragma
6: no-cache
7: server
7: openresty
8: vary
8: Origin
9: x-backend-response
9: 0.002
10: x-tracing-servicename
10: profile-nweb-go
11: x-tracing-spanname
11: MembersHandler_GET
x-backend-server: heifetz.heifetz.heifetz--951-4de26ba7-7c9d7f9948-hwfqs---10.210.190.133:3000[10.210.190.133:3000]
X-Backend-Response: 0.069
Cache-Control: no-cache, no-store, must-revalidate, private, max-age=0
Pragma: no-cache
Vary: Accept-Encoding
X-SecNG-Response: 0.07099986076355
Set-Cookie: _xsrf=z8mbdVxH34t3v5yVbFyGFtWYMjqAXRJR; path=/; domain=zhihu.com; expires=Fri, 24-Jun-22 14:38:57 GMT
x-lb-timing: 0.071
x-idc-id: 2
x-alicdn-da-ups-status: endOs,0,404
x-cdn-provider: alibaba
x-edge-timing: 0.120
Via: c28.l2cm12-6(80,0), c17.cn1780(120,0)
Timing-Allow-Origin: *
EagleId: 78f02c2515783215372268582e