python3 asyncio 不阻塞_连接不与Python3 asyncio并发的HTTP请求关闭

我刚刚开始使用Python3.4中的asyncio库，并编写了一个小程序，试图同时获取50个网页。经过几百次请求后，程序爆炸，出现“打开文件太多”异常。

我认为我的fetch方法用'response.read_and_close()'方法调用来关闭连接。

任何想法发生了什么？我是否正确地解决这个问题？

import asyncio

import aiohttp

@asyncio.coroutine

def fetch(url):

response = yield from aiohttp.request('GET', url)

response = yield from response.read_and_close()

return response.decode('utf-8')

@asyncio.coroutine

def print_page(url):

page = yield from fetch(url)

# print(page)

@asyncio.coroutine

def process_batch_of_urls(round, urls):

print("Round starting: %d" % round)

coros = []

for url in urls:

coros.append(asyncio.Task(print_page(url)))

yield from asyncio.gather(*coros)

print("Round finished: %d" % round)

@asyncio.coroutine

def process_all():

api_url = 'https://google.com'

for i in range(10):

urls = []

for url in range(50):

urls.append(api_url)

yield from process_batch_of_urls(i, urls)

loop = asyncio.get_event_loop()

loop.run_until_complete(process_all())我得到的错误是：

Traceback (most recent call last):

File "/usr/local/lib/python3.4/site-packages/aiohttp/client.py", line 106, in request

File "/usr/local/lib/python3.4/site-packages/aiohttp/connector.py", line 135, in connect

File "/usr/local/lib/python3.4/site-packages/aiohttp/connector.py", line 242, in _create_connection

File "/usr/local/Cellar/python3/3.4.1/Frameworks/Python.framework/Versions/3.4/lib/python3.4/asyncio/base_events.py", line 424, in create_connection

File "/usr/local/Cellar/python3/3.4.1/Frameworks/Python.framework/Versions/3.4/lib/python3.4/asyncio/base_events.py", line 392, in create_connection

File "/usr/local/Cellar/python3/3.4.1/Frameworks/Python.framework/Versions/3.4/lib/python3.4/socket.py", line 123, in __init__

OSError: [Errno 24] Too many open files

During handling of the above exception, another exception occurred: