python mpi4py multiprocessing_Python multiprocessing.get_start_method方法代码示例

本文详细介绍了Python `multiprocessing` 模块的 `get_start_method` 方法,包括其用法和常见代码示例。文章通过22个实例展示了如何在不同场景下使用该方法,涉及进程启动方式的检查、设置以及与信号处理的结合。
摘要由CSDN通过智能技术生成

本文整理汇总了Python中multiprocessing.get_start_method方法的典型用法代码示例。如果您正苦于以下问题:Python multiprocessing.get_start_method方法的具体用法?Python multiprocessing.get_start_method怎么用?Python multiprocessing.get_start_method使用的例子?那么恭喜您, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在模块multiprocessing的用法示例。

在下文中一共展示了multiprocessing.get_start_method方法的22个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Python代码示例。

示例1: start_proc_mask_signal

​点赞 6

# 需要导入模块: import multiprocessing [as 别名]

# 或者: from multiprocessing import get_start_method [as 别名]

def start_proc_mask_signal(proc):

"""

Start process(es) with SIGINT ignored.

Args:

proc: (mp.Process or list)

Note:

The signal mask is only applied when called from main thread.

"""

if not isinstance(proc, list):

proc = [proc]

with mask_sigint():

for p in proc:

if isinstance(p, mp.Process):

if sys.version_info < (3, 4) or mp.get_start_method() == 'fork':

log_once("""

Starting a process with 'fork' method is efficient but not safe and may cause deadlock or crash.

Use 'forkserver' or 'spawn' method instead if you run into such issues.

See https://docs.python.org/3/library/multiprocessing.html#contexts-and-start-methods on how to set them.

""".replace("\n", ""),

'warn') # noqa

p.start()

开发者ID:tensorpack,项目名称:dataflow,代码行数:26,

示例2: main

​点赞 6

# 需要导入模块: import multiprocessing [as 别名]

# 或者: from multiprocessing import get_start_method [as 别名]

def main(args):

with open(args.config) as f:

if version.parse(yaml.version >= "5.1"):

config = yaml.load(f, Loader=yaml.FullLoader)

else:

config = yaml.load(f)

for k, v in config.items():

setattr(args, k, v)

# exp path

if not hasattr(args, 'exp_path'):

args.exp_path = os.path.dirname(args.config)

# dist init

if mp.get_start_method(allow_none=True) != 'spawn':

mp.set_start_method('spawn', force=True)

dist_init(args.launcher, backend='nccl')

# train

trainer = Trainer(args)

trainer.run()

开发者ID:XiaohangZhan,项目名称:conditional-motion-propagation,代码行数:24,

示例3: start_proc_mask_signal

​点赞 6

# 需要导入模块: import multiprocessing [as 别名]

# 或者: from multiprocessing import get_start_method [as 别名]

def start_proc_mask_signal(proc):

"""

Start process(es) with SIGINT ignored.

Args:

proc: (mp.Process or list)

Note:

The signal mask is only applied when called from main thread.

"""

if not isinstance(proc, list):

proc = [proc]

with mask_sigint():

for p in proc:

if isinstance(p, mp.Process):

if sys.version_info < (3, 4) or mp.get_start_method() == 'fork':

log_once(

"Starting a process with 'fork' method is not safe and may consume unnecessary extra CPU memory."

" Use 'forkserver' or 'spawn' method (available after Py3.4) instead if you run into any issues. "

"See https://docs.python.org/3/library/multiprocessing.html#contexts-and-start-methods on how to set them.",

'warn') # noqa

p.start()

开发者ID:junsukchoe,项目名称:ADL,代码行数:25,

示例4: test_interactive_contex_no_main

​点赞 6

# 需要导入模块: import multiprocessing [as 别名]

# 或者: from multiprocessing import get_start_method [as 别名]

def test_interactive_contex_no_main(self):

# Ensure that loky context is working prope

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值