llamafile icon indicating copy to clipboard operation
llamafile copied to clipboard

More LLava style models: https://github.com/Meituan-AutoML/MobileVLM and https://github.com/vikhyat/moondream

Open kinchahoy opened this issue 1 year ago • 2 comments

Could we get LLamafiles for a few more small scale (i.e. ARM friendly) LLava models? If there are instructions to use the LLava 1.5 file to load projection weights from those models that would be just as useful!

kinchahoy avatar May 07 '24 06:05 kinchahoy

Not sure what you mean, but these Llava models have been working fine on my Droid for +2 months. Just use their GGUF versions, e.g. https://huggingface.co/ZiangWu/MobileVLM_V2-1.7B-GGUF, with the regular syntax.

Manamama avatar May 09 '24 11:05 Manamama

Do you have llamafiles for these models? Could you share?

kinchahoy avatar May 11 '24 15:05 kinchahoy