gaodexiaozheng

weight_diff.py state_dict_recovered[key].add_(state_dict_raw[key]) RuntimeError: The size of tensor a (32001) must match the size of tensor b (32000) at non-singleton dimension 0

3

when running the below commend: python weight_diff.py recover --path_raw /models/Llama-2-7b-hf --path_diff /models/alpaca-7b-wdiff --path_tuned ./llama-alpaca-7b-hf it shows the error: RuntimeError: The size of tensor a (32001) must match the size of...

### Reminder - [X] I have read the README and searched the existing issues. ### Reproduction 推理过程的自回归过程中，如果想要修改生成token对应的logits值，以方便自定义采样过程，如何实现 ### Expected behavior _No response_ ### System Info _No response_ ### Others _No...