Python 线程池下载数据

最新推荐文章于 2023-12-29 22:00:00 发布

sh15285118586

最新推荐文章于 2023-12-29 22:00:00 发布

阅读量277

点赞数

分类专栏： Python

本文链接：https://blog.csdn.net/sh15285118586/article/details/114820294

版权

Python 专栏收录该内容

17 篇文章 0 订阅

订阅专栏

from concurrent.futures import ThreadPoolExecutor, ProcessPoolExecutor
import os,time,random,subprocess

def task(cmd):
    print('%s is runing' %os.getpid())
    sub = subprocess.Popen(cmd, shell = True, stdout=subprocess.PIPE, stderr=subprocess.PIPE)
    sub.communicate()
    return cmd

if __name__ == '__main__':
    commlines = []
    with open('./down_file.txt','r') as f:
        for line in f.readlines():
            commlines.append(line.strip('\n'))
        
    executor = ProcessPoolExecutor(max_workers=10)
    futures = []
    for cmd in commlines:
        future = executor.submit(task,cmd)
        futures.append(future)
    executor.shutdown(True)
    print('+++>')
    for future in futures:
        print(future.result())