text-generation-webui icon indicating copy to clipboard operation
text-generation-webui copied to clipboard

Multimodal for llama.cpp GGUF and Llava 1.6

Open Dartvauder opened this issue 11 months ago • 3 comments

Good afternoon. When will multimodality support be added with llama.cpp GGUF? It has already been officially added to llama.cpp itself, but it does not work in your application. In addition, llava 1.6 has already been released. Add support please

Dartvauder avatar Feb 29 '24 08:02 Dartvauder

I would second this. I am beginning to see open-source models that come with their own mmproj files and would like to try them out.

Tetragramm avatar Apr 17 '24 15:04 Tetragramm

+1

oldgithubman avatar Apr 18 '24 05:04 oldgithubman

+1

realsammyt avatar May 02 '24 03:05 realsammyt