RWKV-LM-deepspeed icon indicating copy to clipboard operation
RWKV-LM-deepspeed copied to clipboard

Published 20 hours ago • verified publisher icon mrsteyk

Error after fine tuning with /RWKV-4-Raven-7B-v7-ChnEng-20230404-ctx2048.pth

Open weikeltf opened this issue 1 year ago • 0 comments

RuntimeError: Error(s) in loading state_dict for RWKV: Unexpected key(s) in state_dict: "blocks.24.ln1.weight",.....................

weikeltf avatar Apr 27 '23 02:04 weikeltf