twisted:调用deferredlist多线程并发执行任务然后收集结果

最新推荐文章于 2021-03-01 08:12:53 发布

tudoutest

最新推荐文章于 2021-03-01 08:12:53 发布

阅读量230

点赞数

分类专栏： python 文章标签：多线程 Python Gmail

本文链接：https://blog.csdn.net/tudoutest/article/details/83942996

版权

python 专栏收录该内容

30 篇文章 0 订阅

订阅专栏

最近想通过twisted实现多线程并发去执行一件耗时的事，然后等这些线程都执行完毕后收集他们的结果做一些事。查了下twisted的文档发现deferredlist正好就是做这中事的。附上例子。。。耗时的事用time.sleep来代替了

#! /usr/bin/env python
# -*- coding: utf-8 -*-
#Author:pako
#Email/gtalk:zealzpc@gmail.com
from twisted.python import threadable
threadable.init(1)
from twisted.internet import threads, reactor,defer
from random import randint
import time
    
def run():
    
    result=[]
    
    def listCallback(result):  
        """
                    拿到所有线程执行完返回的结果
        """
        result=[r[1] for r in result]
        print result
        print "deferlist result =", result
    
    def doSomeLongTimeThing(sleeptime=0):  
        """ 
                    每个线程同时做的耗时的事
        """  
        print sleeptime
        time.sleep(sleeptime)
        return sleeptime
    
    deferlist=[]
    #创建deferlist中的deferred
    for i in range(10):
        d = threads.deferToThread(doSomeLongTimeThing,sleeptime=randint(3,5))
        deferlist.append(d)
    #创建deferredlist
    dl = defer.DeferredList(deferlist)
    #给deferredlist添加回调函数
    dl.addBoth(listCallback)
    print "1st line after the addition of the callback"  
    print "2nd line after the addition of the callback"  

if __name__ == '__main__':  
    run()
    reactor.run()