MiniGPT-4 icon indicating copy to clipboard operation
MiniGPT-4 copied to clipboard

stage1.pth load error: size mismatch for llama_proj.weight and bias

Open created-Bi opened this issue 1 year ago • 3 comments

hello, have you changed the parameter size of the llama_proj module?

image

could you double check and re-update the stage1.pth?

created-Bi avatar Apr 24 '23 03:04 created-Bi

Save problem met here.

yPanStupidog avatar Apr 25 '23 23:04 yPanStupidog

I guess this is due to the wrong combination. This would happen when you load the 7b version of minigpt-4 but load the 13b vicuna, or load the 13b version of minigpt-4 but sue the 7b vicuna

TsuTikgiau avatar Apr 26 '23 14:04 TsuTikgiau

ah I just noticed that you are talking about the stage 1. Previously we only provide the stage 1 checkpoint for 13B vicuna. Now we updated the readme to include the 7B version

TsuTikgiau avatar Apr 27 '23 10:04 TsuTikgiau