如何在线程里嵌套多进程并获取返回值

深度学习扛把子

已于 2023-06-14 18:17:29 修改

阅读量115

点赞数

文章标签： python

于 2023-06-14 09:36:51 首次发布

本文链接：https://blog.csdn.net/qq_16792139/article/details/131201016

版权

文章展示了如何在Python中使用多进程和线程处理任务，通过`multiprocessing.Process`创建子进程，利用`Manager.Queue`进行通信。同时，引入了回调函数`callback`来处理子进程完成后的结果，确保主线程能获取并打印所有的子任务结果。

摘要由CSDN通过智能技术生成

import threading
from multiprocessing import Process, Manager

def child_func(name, queue):
    result = name
    queue.put(result)

def thread_func(queue):
    p1 = Process(target=child_func, args=("Child 1", queue))
    p2 = Process(target=child_func, args=("Child 2", queue))

    p1.start()
    p2.start()

    p1.join()
    p2.join()

    results = []
    while not queue.empty():
        result = queue.get()
        print(result)
        results.append(result)

    print("Thread finished.")
    return results

if __name__ == '__main__':
    manager = Manager()
    queue = manager.Queue()

    t = threading.Thread(target=thread_func, args=(queue,))
    t.start()
    t.join()

    results = []
    while not queue.empty():
        result = queue.get()
        results.append(result)

    print("Main process finished.")
    print("Results:", results)

但是无法获取到返回值
在这里插入图片描述
用回调函数改进后

import threading
from multiprocessing import Process, Manager

def child_func(name, queue):
    result = name
    queue.put(result)

def thread_func(callback,queue):
    p1 = Process(target=child_func, args=("Child 1", queue))
    p2 = Process(target=child_func, args=("Child 2", queue))

    p1.start()
    p2.start()

    p1.join()
    p2.join()

    # results = []
    # while not queue.empty():
    #     # result = queue.get()
    #     # print(result)
    #     callback(queue)

    print("Thread finished.")
    # return results

def callback(queue):
    # 从队列中获取结果
    results = []
    while not queue.empty():
        result = queue.get()
        results.append(result)
        print(f"The result is {result}")
        
    return results

if __name__ == '__main__':
    manager = Manager()
    queue = manager.Queue()

    # t = threading.Thread(target=thread_func, args=(queue,))
    t = threading.Thread(target=thread_func, args=(callback,queue,))

    t.start()
    t.join()

    results = []
    # while not queue.empty():
    #     result = queue.get()
    #     results.append(result)
    results = callback(queue)
    print("Main process finished.")
    print("Results:", results)