vllm icon indicating copy to clipboard operation
vllm copied to clipboard

[New Model]: Request to integrate Chexagent Multimodel in vLLM

Open MohnishJain opened this issue 6 months ago • 1 comments

The model to consider.

https://huggingface.co/StanfordAIMI/CheXagent-8b

The closest model vllm already supports.

https://huggingface.co/microsoft/llava-med-v1.5-mistral-7b

What's your difficulty of supporting the model you want?

when i tried to host chexagent it says, model architecture not supported by vllm.its has integrated qformer inside this.any help in integrating this will be helpful.

Before submitting a new issue...

  • [X] Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

MohnishJain avatar Aug 26 '24 06:08 MohnishJain