once-for-all: RuntimeError: Mismatched BROADCAST tensor shapes: One rank sent a ...
参考:https://github.com/horovod/horovod/commit/ecbda18ee8c3fd5b3ff2b8d319c34873f1f76f9d注释掉以下两行代码即可:hvd.broadcast_parameters(model.state_dict(), root_rank=0)hvd.broadcast_optimizer_state(optimizer, root_rank=0)
原创
2020-09-23 16:01:22 ·
247 阅读 ·
0 评论