RuntimeError: context has already been set

本文介绍了解决multiprocessing模块中重复设置start_method导致的RuntimeError问题。当尝试第二次设置start_method或在获取方法后设置时,会出现此错误。通过设置force=True参数可以避免这一问题。

RuntimeError: context has already been set解决方案

问题出现的原因:
当 multiprocessing 模块被第二次配置 start_method 时会报错

import multiprocessing

if __name__ == '__main__':
    multiprocessing.set_start_method('spawn')
    multiprocessing.set_start_method('spawn')

或者在 get_start_method 后配置 start_method 也会报错:

import multiprocessing

if __name__ == '__main__':
    print(multiprocessing.get_start_method())
    multiprocessing.set_start_method('spawn')

错误信息:

RuntimeError: context has already been set

在这里插入图片描述

解决方案:
在配置 start_method 时配置参数 force=True

import multiprocessing

if __name__ == '__main__':
    print(multiprocessing.get_start_method())
    multiprocessing.set_start_method('spawn', force=True)
File "/home/vcdc/anaconda3/envs/uniAD/lib/python3.8/multiprocessing/context.py", line 243, in set_start_method raise RuntimeError('context has already been set') RuntimeError: context has already been set ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 489107) of binary: /home/vcdc/anaconda3/envs/uniAD/bin/python Traceback (most recent call last): File "/home/vcdc/anaconda3/envs/uniAD/lib/python3.8/runpy.py", line 194, in _run_module_as_main return _run_code(code, main_globals, None, File "/home/vcdc/anaconda3/envs/uniAD/lib/python3.8/runpy.py", line 87, in _run_code exec(code, run_globals) File "/home/vcdc/anaconda3/envs/uniAD/lib/python3.8/site-packages/torch/distributed/run.py", line 723, in <module> main() File "/home/vcdc/anaconda3/envs/uniAD/lib/python3.8/site-packages/torch/distributed/elastic/multiprocessing/errors/__init__.py", line 345, in wrapper return f(*args, **kwargs) File "/home/vcdc/anaconda3/envs/uniAD/lib/python3.8/site-packages/torch/distributed/run.py", line 719, in main run(args) File "/home/vcdc/anaconda3/envs/uniAD/lib/python3.8/site-packages/torch/distributed/run.py", line 710, in run elastic_launch( File "/home/vcdc/anaconda3/envs/uniAD/lib/python3.8/site-packages/torch/distributed/launcher/api.py", line 131, in __call__ return launch_agent(self._config, self._entrypoint, list(args)) File "/home/vcdc/anaconda3/envs/uniAD/lib/python3.8/site-packages/torch/distributed/launcher/api.py", line 259, in launch_agent raise ChildFailedError( torch.distributed.elastic.multiprocessing.errors.ChildFailedError:
10-01
评论 1
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

聚精会神搞学习

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付:¥1
获取中
扫码支付

您的余额不足,请更换扫码支付或充值

打赏作者

实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值