Iven2132
Iven2132
> We are currently in the process of improving support for vision-language models. (See #4194) @DarkLight1337 Can I currently deploy https://huggingface.co/OpenGVLab/InternVL-Chat-V1-2-Plus on vLLM?
> > @DarkLight1337 Can I currently deploy https://huggingface.co/OpenGVLab/InternVL-Chat-V1-2-Plus on vLLM? > > You'll at least have to write code for implementing the model in vLLM and registering it so it...
> > I don't even code in Python, Can I just replace tokenizer with llava 1.5 and just loadOpenGVLab/InternVL-Chat-V1-2-Plus > > That's not possible in general. You'll have to wait...
> > I don't even code in Python, Can I just replace tokenizer with llava 1.5 and just loadOpenGVLab/InternVL-Chat-V1-2-Plus > > That's not possible in general. You'll have to wait...
> > @DarkLight1337 I don't if it's a valid question but - Does vLLM support all architectures said in the readme, so that means I just need to replace the...
Did you find something? I'm looking for same
> Hello, we also very much hope to make this model run faster and have been attempting some improvements in this area recently. I will keep you updated on any...
@lgrammel Hi! I can't find the example app for speech streaming in the Vercel AI SDK repo. where it's gone?
Hi @MaxLeiter Can you merge this?
Hi @MaxLeiter Can you please approve this?