InternVL icon indicating copy to clipboard operation
InternVL copied to clipboard

[Bug] 76B模型finetuning之后,带--auto加载checkpoint时,报错

Open linxi1158 opened this issue 1 year ago • 0 comments

Checklist

  • [ ] 1. I have searched related issues but cannot get the expected help.
  • [ ] 2. The bug has not been fixed in the latest version.
  • [ ] 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.

Describe the bug

CleanShot 2024-09-24 at 11 10 59 76B模型finetuning之后,带--auto加载checkpoint时,language_model.base_model.model.model.embed_toekns.weight does not have any device set,如果使用官方提供的76B模型测试则正常运行 命令行:GPUS=8 sh evaluate.sh pretrained/InternVL2-Llama3-76B mvbench --dynamic --max-num 1 --auto

Reproduction

Environment

Error traceback

linxi1158 avatar Sep 24 '24 03:09 linxi1158