llava-cpp-server icon indicating copy to clipboard operation
llava-cpp-server copied to clipboard
verified publisher icon trzy

CMake Build?

Open danielelongo14 opened this issue 1 year ago • 2 comments

Hello, is it possible to compile with cmake? Because with make it doesn't detect cuda

danielelongo14 avatar Sep 12 '24 15:09 danielelongo14

Not planned but I would accept a PR if you do it. I haven't touched this code since I released it and since then, llama.cpp has added support for LLaVA along with an API interface. I would advise looking at that project if you really need this capability.

trzy avatar Sep 12 '24 17:09 trzy

Ok thank you, unfortunately llama.cpp has dropped support for multimodal models for the server

danielelongo14 avatar Sep 12 '24 21:09 danielelongo14