LLaMA-Factory icon indicating copy to clipboard operation
LLaMA-Factory copied to clipboard

改变词表大小无法运行怎么办?

Open CanvaChen opened this issue 9 months ago • 0 comments

ValueError: Trying to set a tensor of shape torch.Size([128256, 4096]) in "weight" (which has shape torch.Size([36984, 4096])), this look incorrect.

llama3的词表被我替换成自己的,想重新训练一些层,但运行报错维度不匹配了。

CanvaChen avatar May 13 '24 15:05 CanvaChen