moondream icon indicating copy to clipboard operation
moondream copied to clipboard

Availability On Ollama

Open jeffreylm opened this issue 11 months ago • 4 comments

Dear Team,

Is there anyway we could see this model availanle via Ollama?

Thank you in advance, Jeffrey

jeffreylm avatar Mar 07 '24 16:03 jeffreylm

I think when the gguf format is ready

vedank07 avatar Mar 07 '24 16:03 vedank07

Thank you for the response.

jeffreylm avatar Mar 07 '24 18:03 jeffreylm

@jeffreylm Apparently somebody has made gguf format of this model, I have never tested it. If you want to give it a try, here is the link: https://huggingface.co/sroecker/moondream2-GGUF/tree/main

KPCOFGS avatar Apr 12 '24 13:04 KPCOFGS

How should the Modelfile be set up to work with ollama?

nicorinn avatar Apr 23 '24 00:04 nicorinn

It is available now! You may need to use the latest pre-release version of ollama. https://ollama.com/library/moondream

vikhyat avatar Apr 30 '24 19:04 vikhyat