参考链接 https://devblogs.nvidia.com/massively-scale-deep-learning-training-nccl-2-4/ 转载于:https://www.cnblogs.com/yangwenhuan/p/11390770.html