RWKV-LM icon indicating copy to clipboard operation
RWKV-LM copied to clipboard

Published 20 hours ago • verified publisher icon BlinkDL

RWKV-7中的代码，加载huggingface中的预训练模型报错

Open uniquehou opened this issue 7 months ago • 3 comments

在第一个block会多一个attn（"blocks.0.att.v1", "blocks.0.att.v2", "blocks.0.att.v0".）,其它层正常

Image

Image

uniquehou avatar Apr 10 '25 08:04 uniquehou