关于Python进程池pool与pyinstaller打包exe程序运行的奇怪问题!
最近想吧自己写的py文件打包成exe文件给别人用,学习了pyinstaller也基本会用了,但是在打包多进程程序的时候遇到奇怪问题,向各位求解。
我吧程序简化了下:
import multiprocessing
def do(n): # 参数n由args=(1,)传入
name = multiprocessing.current_process().name # 获取当前进程的名字
print(name, 'starting')
print("worker ", n)
return
if __name__ == '__main__':
numList = []
for i in range(5):
p = multiprocessing.Process(target=do, args=(i,)) # (i,)中加入","表示元祖
numList.append(p)
print(numList)
p.start() # 用start()方法启动进程,执行do()方法
p.join() # 等待子进程结束以后再继续往下运行,通常用于进程间的同步
print("Process end.")
程序很简单,是用进程池分开执行多个方法的。
在pycharm中执行很正常,如下:调用了五个Process。
[<Process name='Process-1' parent=10316 initial>]
Process-1 starting
worker 0
[<Process name='Process-1' pid=21204 parent=10316 stopped exitcode=0>, <Process name='Process-2' parent=10316 initial>]
Process-2 starting
worker 1
[<Process name='Process-1' pid=21204 parent=10316 stopped exitcode=0>, <Process name='Process-2' pid=17916 parent=10316 stopped exitcode=0>, <Process name='Process-3' parent=10316 initial>]
Process-3 starting
worker 2
[<Process name='Process-1' pid=21204 parent=10316 stopped exitcode=0>, <Process name='Process-2' pid=17916 parent=10316 stopped exitcode=0>, <Process name='Process-3' pid=2808 parent=10316 stopped exitcode=0>, <Process name='Process-4' parent=10316 initial>]
Process-4 starting
worker 3
[<Process name='Process-1' pid=21204 parent=10316 stopped exitcode=0>, <Process name='Process-2' pid=17916 parent=10316 stopped exitcode=0>, <Process name='Process-3' pid=2808 parent=10316 stopped exitcode=0>, <Process name='Process-4' pid=10656 parent=10316 stopped exitcode=0>, <Process name='Process-5' parent=10316 initial>]
Process-5 starting
worker 4
Process end.
但是用pyinstaller 打包EXE文件,问题来了,打包过程也很简单>pyinstaller -F XXX.py
然后我执行EXE文件,意向不到的结果来了,死循环!!!!!!!!!!!不会结束。
[<Process name='Process-1' parent=13260 initial>]
[<Process name='Process-1' parent=3812 initial>]
[<Process name='Process-1' parent=12184 initial>]
[<Process name='Process-1' parent=9676 initial>]
[<Process name='Process-1' parent=19108 initial>]
[<Process name='Process-1' parent=4860 initial>]
[<Process name='Process-1' parent=21284 initial>]
[<Process name='Process-1' parent=5760 initial>]
[<Process name='Process-1' parent=15204 initial>]
[<Process name='Process-1' parent=3976 initial>]
[<Process name='Process-1' parent=14972 initial>]
[<Process name='Process-1' parent=18228 initial>]
[<Process name='Process-1' parent=15812 initial>]
[<Process name='Process-1' parent=18348 initial>]
[<Process name='Process-1' parent=18688 initial>]
[<Process name='Process-1' parent=21000 initial>]
[<Process name='Process-1' parent=17556 initial>]
[<Process name='Process-1' parent=17540 initial>]
[<Process name='Process-1' parent=16516 initial>]
[<Process name='Process-1' parent=14220 initial>]
[<Process name='Process-1' parent=18400 initial>]
[<Process name='Process-1' parent=20660 initial>]
[<Process name='Process-1' parent=12124 initial>]
[<Process name='Process-1' parent=16644 initial>]
[<Process name='Process-1' parent=4344 initial>]
[<Process name='Process-1' parent=8568 initial>]
[<Process name='Process-1' parent=2960 initial>]
[<Process name='Process-1' parent=19948 initial>]
[<Process name='Process-1' parent=3640 initial>]
[<Process name='Process-1' parent=18336 initial>]
[<Process name='Process-1' parent=15684 initial>]
[<Process name='Process-1' parent=17136 initial>]
[<Process name='Process-1' parent=12816 initial>]
[<Process name='Process-1' parent=13392 initial>]
[<Process name='Process-1' parent=19692 initial>]
[<Process name='Process-1' parent=21172 initial>]
[<Process name='Process-1' parent=13280 initial>]
[<Process name='Process-1' parent=7536 initial>]
[<Process name='Process-1' parent=10968 initial>]
[<Process name='Process-1' parent=15868 initial>]
...............一直运行,不会停止。反复新建进程。内存cpu使用极高。
有哪位大哥遇到过这类问题,如何解决的?求指路?
出坑:解决了!!!!!!!!!!!!!
在if __name__ == '__main__': 中加入:multiprocessing.freeze_support()
即:
import multiprocessing
def do(n): # 参数n由args=(1,)传入
name = multiprocessing.current_process().name # 获取当前进程的名字
print(name, 'starting')
print("worker ", n)
return
if __name__ == '__main__':
#这里加入
multiprocessing.freeze_support()
#~~~~~~~~~~~~~~~~~~~~~~~~~
numList = []
for i in range(5):
p = multiprocessing.Process(target=do, args=(i,)) # (i,)中加入","表示元祖
numList.append(p)
print(numList)
p.start() # 用start()方法启动进程,执行do()方法
p.join() # 等待子进程结束以后再继续往下运行,通常用于进程间的同步
print("Process end.")
解决思路见:寻寻觅觅oO的:pyinstaller 打包成 exe 遇到的一些坑
知识点:
1、因为开启子进程是不支持打包exe文件的,所以会不停向操作系统申请创建子进程,
而这个代码 multiprocessing.freeze_support() 作用就是支持打包到Windows的EXE文件。
2、多进程的程序运行后,如果直接关闭控制台窗口,那么整个程序都会退出。
如果是 进入 任务管理器,单独结束 控制窗口 的进程,如果子进程不是守护进程,那么子进程还是会继续运行。
3、如果是多线程的,则没这个问题,可以直接打包。
但有个小提示, 如果是 tkinter 的图形界面运行的,是多线程的话,如果子线程不是守护线程,那么关掉主界面后,子线程会继续运行。
如果也是控制台窗口的话,效果和上面 2 提到的进程效果一样。
见这里:Jack千斤顶的:用pyinstaller打包包含多进程的程序时,进程自动重启,进程自动增加至电脑死机问题。使用了from multiprocessing.pool import Pool来使用多线程池