vllm
vllm copied to clipboard
[New Model]: Request to integrate Chexagent Multimodel in vLLM
The model to consider.
https://huggingface.co/StanfordAIMI/CheXagent-8b
The closest model vllm already supports.
https://huggingface.co/microsoft/llava-med-v1.5-mistral-7b
What's your difficulty of supporting the model you want?
when i tried to host chexagent it says, model architecture not supported by vllm.its has integrated qformer inside this.any help in integrating this will be helpful.
Before submitting a new issue...
- [X] Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.