Plans for adding Qwen2VL model?

[ashwani-bhat]

Model description

Are there any plans to add Qwen2VL model. I see that there was a past feature request for adding VLMs (#179) Are there any plans for this?

Also, can you help me with some guide on how to add a new model in LoRAX, specially a vision language model like Qwen2VL.

Thank you

Open source status

• [x] The model implementation is available
• [x] The model weights are available

Provide useful links for the implementation

No response