vllm icon indicating copy to clipboard operation
vllm copied to clipboard

[New Model]: Google's Paligemma family of models

Open nfplay opened this issue 9 months ago • 1 comments

The model to consider.

https://huggingface.co/google/paligemma-3b-pt-896

The closest model vllm already supports.

I think the only visual language model supported right now is LLava but I could be wrong.

What's your difficulty of supporting the model you want?

No response

nfplay avatar May 15 '24 13:05 nfplay

MiniCPM is also supported.

Excited to test out how PaliGemma compares, especially when analyzing GUI images: https://github.com/OpenAdaptAI/OpenAdapt/issues/637

abrichr avatar May 15 '24 19:05 abrichr

I'm working on a PR for this currently. See #5189

ywang96 avatar Jun 02 '24 01:06 ywang96