python requests请求_python-requests – 使用grequests发送请求池,如何获得每个请求的响应时间？...

grequests与请求一样,支持一个hook关键字参数,您可以在其中分配一个对响应对象执行某些操作的函数：

def do_something(response):

print response.status_code

unsentrequests=(grequests.get(u, hooks = {'response' : do_something}) for u in self.urls)

responses=grequests.map(unsentrequests)

我更喜欢使用gevent直接在循环中使用请求以获得更明确的代码：

import gevent.monkey

gevent.monkey.patch_socket()

from gevent.pool import Pool

import requests

def check_urls(urls):

def fetch(url):

response = requests.request('GET', url, timeout=5.0)

print "Status: [%s] URL: %s" % (response.status_code, url)

pool = Pool(20)

for url in urls:

pool.spawn(fetch, url)

pool.join()