问题:
Pretrain on Wav2vec2 getting parameters did not receive grad for rank0
解决方法:
来自github的issue链接: Pretrain on Wav2vec2 getting parameters did not receive grad for rank0
预训练没问题,分布式预训练时报错,将模型配置中的layerdrop
设置为0
即可正常运行分布式预训练。
问题:
Pretrain on Wav2vec2 getting parameters did not receive grad for rank0
解决方法:
来自github的issue链接: Pretrain on Wav2vec2 getting parameters did not receive grad for rank0
预训练没问题,分布式预训练时报错,将模型配置中的layerdrop
设置为0
即可正常运行分布式预训练。