Alexis

Results 5 comments of Alexis

Very slow cold starts even with flashboot

Any update on this? @pandyamarut why did your PR got reverted?

VLLM integration

Has anyone managed to get Moondream working on vLLM?

Ovis2.5-2B Inference speed

I did not try with vLLM. But yes, I think it's not supported yet. But it will be soon: https://github.com/vllm-project/vllm/pull/23084

How to use /detect /point with VLLM API

Moondream does not work on vLLM.

Model does not exist

I think i found a solution... but i'm sure there is a better way... When using a local path for the model you must pass the full path when doing...