lmm.cpp icon indicating copy to clipboard operation
lmm.cpp copied to clipboard

Published 20 hours ago • verified publisher icon monatis

Thank you for you work!

Open lhr0909 opened this issue 2 years ago • 5 comments

I am super excited to be able to use LLaVa.cpp when it is available. I know you are busy working and maintaining other ggml projects. And please let us know when you are thinking to work on this and have a working prototype for us to test.

Thanks again!

lhr0909 avatar Aug 26 '23 12:08 lhr0909

Hi @lhr0909, thanks for reaching out!

Yes I was busy with some contractual work and other higher-priority GGML PRs, mostly for GGUF. Now that it' landed, I'm ready for giving it a go --hopefully tomorrow, and hope that it'll be ready for a test this week.

LLaVA will be the first supported model, and I also hope to support HF's new Idefics next.

monatis avatar Aug 26 '23 13:08 monatis

seems yes ... look to pull

mirek190 avatar Oct 08 '23 18:10 mirek190

I'll implement this in llama.cpp, --will be ready this week.

It turned out to be easier to start in llama.cpp, then maybe we can move it to this dedicated repo for more features, models etc.

monatis avatar Oct 08 '23 18:10 monatis

WOW ... can't wait to check it ;D

mirek190 avatar Oct 08 '23 22:10 mirek190

Just wanted to say @monatis I'm having a great time using llava inside of llama. I also played with your clip.cpp.

z3ugma avatar Oct 30 '23 04:10 z3ugma