InternVL2-26B模型微调后，报UnboundLocalError: local variable 'head_num' referenced before assignment错误

Open feihuamantian opened this issue 1 year ago • 9 comments

Jul 11 '24 01:07 feihuamantian

我也在全量微调InternVL2-26B，没有出现上述问题。

Jul 11 '24 12:07 tdye24

same here. I also finetuned mini-internVL (Lora Finetuning). Facing the same error.. can someone help?

Jul 12 '24 01:07 shiva-vardhineedi

我也在全量微调InternVL2-26B，没有出现上述问题。

想请教一下，有没有InternVL2-26B全量微调的参考呀？

Jul 12 '24 06:07 EthanLeo-LYX

请教一下有4张3090的卡为啥这个26B模型只能在一张卡上跑

Jul 15 '24 07:07 wangyang1923

我也在全量微调InternVL2-26B，没有出现上述问题。

想请教一下，有没有InternVL2-26B全量微调的参考呀？

请参考：https://internvl.readthedocs.io/en/latest/internvl2.0/finetune.html#start-2nd-fine-tuning

Jul 31 '24 07:07 G-z-w

请教一下有4张3090的卡为啥这个26B模型只能在一张卡上跑

请问您用的是什么框架

Jul 31 '24 07:07 G-z-w

same here. I also finetuned mini-internVL (Lora Finetuning). Facing the same error.. can someone help?

Our new code has been released, please refer to https://internvl.readthedocs.io/en/latest/internvl2.0/finetune.html#start-2nd-fine-tuning.

Jul 31 '24 07:07 G-z-w