大模型部署避坑指南--RuntimeError: The size of tensor a (32000) must match the size of tensor b (32001) ...

问题描述:

minigpt4模型权重准备:

python -m fastchat.model.apply_delta --base /path/to/llama-7b-hf/  --target /path/to/save/working/vicuna/weight/  --delta /path/to/vicuna-7b-delta-v0/

RuntimeError: The size of tensor a (32000) must match the size of tensor b (32001) at non-singleton dimension 0

 产生原因:

fastchat版本与模型版本 不兼容

解决办法:

将vicuna-7b-delta-v0 替换为 vicuna-7b-delta-v1.1 版本

下载地址:

lmsys/vicuna-7b-delta-v1.1 at main

python -m fastchat.model.apply_delta --base /path/to/llama-7b-hf/  --target /path/to/save/working/vicuna/weight/  --delta /path/to/vicuna-7b-delta-v1.1/

  • 1
    点赞
  • 2
    收藏
    觉得还不错? 一键收藏
  • 1
    评论
引用\[1\]和\[2\]提到了类似的错误信息,即"RuntimeError: The size of tensor a (4) must match the size of tensor b (2) at non-singleton dimension 1"和"RuntimeError: The size of tensor a (4) must match the size of tensor b (3) at non-singleton dimension 0"。这些错误通常是由于维度信息不匹配导致的。引用\[2\]中提供了一个解决办法,即将图像转换为RGB格式。因此,对于你的问题"RuntimeError: The size of tensor a (84) must match the size of tensor b (56) at non-singleton dimension 3",你可以尝试将图像转换为RGB格式来解决这个问题。 #### 引用[.reference_title] - *1* [RuntimeError: The size of tensor a (4) must match the size of tensor b (2) at non-singleton dimensio](https://blog.csdn.net/weixin_44337238/article/details/124293003)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v91^control_2,239^v3^insert_chatgpt"}} ] [.reference_item] - *2* [报错解决——RuntimeError: The size of tensor a (4) must match the size of tensor b (3) at non-...](https://blog.csdn.net/Williamcsj/article/details/125746752)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v91^control_2,239^v3^insert_chatgpt"}} ] [.reference_item] - *3* [RuntimeError: The size of tensor a (4) must match the size of tensor b (3) at non-singleton dimensio](https://blog.csdn.net/weixin_46135327/article/details/130805823)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v91^control_2,239^v3^insert_chatgpt"}} ] [.reference_item] [ .reference_list ]
评论 1
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值