python urlopen函数的timeout,求大神指点: urllib2.urlopen(url,timeout=10).read() 循环采集 如果一超时后报错 然后就停止运行了...

在使用Python的urllib2模块进行网页抓取时,遇到超时问题导致程序中断。为确保程序在超时时仍能继续运行,需要捕获并处理异常。在urlopen函数中添加try-except块,对超时错误进行捕获,并设置重试机制,以增强爬虫的健壮性。
摘要由CSDN通过智能技术生成

urllib2.urlopen(url,timeout=10).read() 循环采集 如果一超时后报错 然后就停止运行了

请问一下如果超时了还让程序继续运行下去!

Traceback (most recent call last):

File "E:\PYTHON EXAMPLE\robot.py", line 114, in

runTask(work, day=0, hour=0, min=0, second=5)

File "E:\PYTHON EXAMPLE\robot.py", line 104, in runTask

func()

File "E:\PYTHON EXAMPLE\robot.py", line 55, in work

bk_browse = urllib2.urlopen(url,timeout=10).read()

File "C:\Python27\lib\urllib2.py", line 154, in urlopen

return opener.open(url, data, timeout)

File "C:\Python27\lib\urllib2.py", line 431, in open

response = self._open(req, data)

File "C:\Python27\lib\urllib2.py", line 449, in _open

'_open', req)

File "C:\Python27\lib\urllib2.py", line 409, in _call_chain

result = func(*args)

File "C:\Python27\lib\urllib2.py", line 1227, in http_open

return self.do_open(httplib.HTTPConnection, req)

File "C:\Python27\lib\urllib2.py", line 1200, in do_open

r = h.getresponse(buffering=True)

File "C:\Python27\lib\httplib.py", line 1074, in getresponse

response.begin()

File "C:\Python27\lib\httplib.py", line 415, in begin

version, status, reason = self._read_status()

File "C:\Python27\lib\httplib.py", line 371, in _read_status

line = self.fp.readline(_MAXLINE + 1)

File "C:\Python27\lib\socket.py", line 476, in readline

data = self._sock.recv(self._rbufsize)

error: [Errno 10054]

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值