超级会员免费看
GPT-4训练可能使用了10,000到25,000块A100 GPU，Meta拥有21,000块A100，Tesla持有7,000块，而Stability AI有5,000块。Falcon-40B使用了384块A100，Inflection的GPT-3.5等效模型则使用了3,500块H100 GPU。"
127736289,15747596,STM32单片机GPIO详解,"['STM32', '单片机', '嵌入式硬件']
How Many GPUs Are Needed?
- GPT-4 was likely trained on somewherebetween 10,000 to 25,000 A100s.
- Meta has about 21,000 A100s,
- Tesla hasabout 7,000 A100s,
- Stability Al hasabout 5,000 A100s.
- Falcon-40B was trained on 384 A100s
- Inflection used 3,500 H100s for their GPT-3.5 equivalent model
扫一扫
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
