Xia Yu comments

Results 6 comments of


                                            Xia Yu

哪位大佬帮忙看看，微调出现维度不一致问题； RuntimeError: The size of tensor a (25165824) must match the size of tensor b (12288) at non-singleton dimension 0

> 请问这个问题解决了吗，就是维度不一致的问题

哪位大佬帮忙看看，微调出现维度不一致问题； RuntimeError: The size of tensor a (25165824) must match the size of tensor b (12288) at non-singleton dimension 0

> > 我这边是可以跑起来的，你看一下你的代码和VisualGLM-6B的main分支一致吗？是不是没有更新到最新版或者你本地改了什么？以及bitsandbytes是不是0.39.0版本。 > > 修改了 finetune_visualglm.py #176行 args.device = 'cpu' 修改成 args.device = 'cuda' > > 错误就从RuntimeError: Error building extension 'fused_adam'，变成了维度问题RuntimeError: The size of tensor a (25165824) must...

[VLLM integration][90% completed] Add Ovis2 to VLLM

@mlinmg # Thank You for the OVIS PR Thank you very much for your work on porting OVIS to VLLM! I see you've addressed the needs from multiple community issues,...

[VLLM integration][90% completed] Add Ovis2 to VLLM

@mlinmg @Isotr0py Thank you for your responses. I've made further progress on implementing the `max_partition` parameter for OVIS in VLLM. I can confirm that I've modified the OVIS processor to...

Is there a fine-tuning or Lora process for the Ovis 2.5-2B?

Hi~ The official code already supports fine-tuning, see here: https://github.com/AIDC-AI/Ovis?tab=readme-ov-file#model-fine-tuning

Ovis2.5-2B Inference speed

You can try using vLLM for inference acceleration, see here: https://github.com/AIDC-AI/Ovis?tab=readme-ov-file#install