模型 | 参数 | Layers |
Bert Base | 110M | 12 |
Bert Large | 340M | 24 |
GPT2-small | 117M | 12 |
GPT2-medium | 345M | 24 |
GPT2-large | 762M | 36 |
GPT2-extern-large | 1.542B | 48 |
GPT3-small | 125M | 12 |
GPT3-medium | 350M | 24 |
GPT3-large | 760M | 24 |
GPT3-XL | 1.3B | 24 |
GPT3-2.7B | 2.7B | 32 |
GPT3-6.7B | 6.7B | 32 |
GPT3-13B | 13B | 40 |
GPT3-175B | 175B | 96 |
LLaMa | 7B | |
LLaMa | 13B | |
LLaMa | 33B | |
LLaMa | 65B | |
BLOOM | 560M | |
BLOOM | 1.1B | |
BLOOM | 1.7B | |
BLOOM | 3B | |
BLOOM | 7.1B | |
BLOOM | 176B | |
AI模型参数大小
于 2023-05-17 11:31:19 首次发布