nano-vllm
nano-vllm copied to clipboard
GeeeekExplorer
Implement support for Qwen2.5vl
Great work on this minimal implementation!
- I'm interested in extending the nano-vllm framework to support Qwen2.5vl.
- Since Qwen3 has already been implemented, most of the necessary building blocks are in place. I would love to contribute by adding Qwen2.5vl models.
Please let me know your thoughts.
Thank you for your interest in extending nano-vllm!
As nano-vllm is primarily designed for educational purposes to demonstrate the core concepts of LLM serving, we're currently keeping the scope limited to maintain focus. The Qwen3 implementation already serves this purpose well, so we don't have plans to officially support additional model variants at this time.
However, we'd be happy to see community contributions like yours! You're absolutely welcome to implement Qwen2.5vl support in your own fork of the project. If you do create such an implementation, we'd be glad to help promote it by linking to your work from the main nano-vllm repository (perhaps in a "Community Extensions" section).
@GeeeekExplorer That sounds amazing. I will try to get a qwen2.5vl version working on a fork and add a comment here once done. I think this a great learning experience and should be shared with other people as well.
Thank you for the kind suggestion of promoting it via community extensions section !
@Atharva-Phatak hi, I am also interested in extending nano-vllm to support Qwen2.5vl. May I ask if you have made any progress?
@GeeeekExplorer That sounds amazing. I will try to get a qwen2.5vl version working on a fork and add a comment here once done. I think this a great learning experience and should be shared with other people as well.
Thank you for the kind suggestion of promoting it via community extensions section !
hey, guys ,how is going ? I am looking forward it deeply
