llmware icon indicating copy to clipboard operation
llmware copied to clipboard

Published 20 hours ago • verified publisher icon llmware-ai

Error(s) in loading state_dict for LlamaForCausalLM

Open jamartinh opened this issue 1 year ago • 0 comments

Hi with some models I experience the following error:

RuntimeError: Error(s) in loading state_dict for LlamaForCausalLM:
	size mismatch for model.layers.0.self_attn.k_proj.weight: copying a param with shape torch.Size([256, 2048]) from checkpoint, the shape in current model is torch.Size([2048, 2048]).

Code is:

python my_model = ModelCatalog().load_model("llmware/slim-emotions")

jamartinh avatar Feb 17 '24 11:02 jamartinh