moondream icon indicating copy to clipboard operation
moondream copied to clipboard
verified publisher icon vikhyat

VLLM integration

Open SMDIndomitable opened this issue 5 months ago • 1 comments

Hi, would it be possible to make this work on vllm. I saw the thread you posted last year that is not possible, but now with FlexAttention available, would it be possible?

Thank you so much for the amazing work!

SMDIndomitable avatar Jul 05 '25 03:07 SMDIndomitable

Has anyone managed to get Moondream working on vLLM?

AlexisMDP avatar Aug 06 '25 13:08 AlexisMDP