TinyLLaVA_Factory icon indicating copy to clipboard operation
TinyLLaVA_Factory copied to clipboard

[Feature Request] qwen2.5 and llava onevision

Open sailfish009 opened this issue 1 year ago • 5 comments

Hi, we would love to see you add the latest models to take advantage of the modular structure. For example, it would be nice to be able to use models like llava-onevision-qwen2.5-7b.

https://github.com/QwenLM/Qwen2.5

sailfish009 avatar Nov 14 '24 11:11 sailfish009

Thank you for your suggestion, we will update it as soon as possible.

ZhangXJ199 avatar Nov 17 '24 02:11 ZhangXJ199

Yes. Looking forward to the incorporations of qwen series.

yi-ming-qian avatar Nov 21 '24 00:11 yi-ming-qian

We have added qwen2.5-0.5B and qwen2.5-1.5B to the Model Performance leaderboard. The training script can refer to qwen2.

ZhangXJ199 avatar Nov 21 '24 02:11 ZhangXJ199

Thanks. Have you considered to incorporate qwen 7b models?

yi-ming-qian avatar Nov 21 '24 08:11 yi-ming-qian

The qwen2.5-7B has higher requirements on the machine. We may try it later.

ZhangXJ199 avatar Nov 21 '24 13:11 ZhangXJ199