lms icon indicating copy to clipboard operation
lms copied to clipboard

Vision Adapter not loading when model loaded with lms

Open Swicegood opened this issue 6 months ago • 0 comments

2024-07-28 15:02:45,079 - ERROR - LLM completion error: Error code: 400 - {'error': '<LM Studio error> Vision model is not loaded. Cannot process images. Suggestion: Make sure to load both the primary and the Vision Adapter models. See more info in https://huggingface.co/collections/lmstudio-ai/vision-models-gguf-6577e1ce821f439498ced0c1. Error Data: n/a, Additional Data: n/a'}

The model is responding just fine to request for image descriptions when run form the GUI.

my model folder llava-1.6-mistral-7b-gguf has two files in it llava-v1.6-mistral-7b.Q8_0.gguf, and mmproj-model-f16.gguf

PS C:\Users\Administrator> lms load --gpu=1.0
I LM Studio is not running in server mode. Starting the server...
I Successfully started the server and verified it is running.

! Use the arrow keys to navigate, type to filter, and press enter to select.

? Select a model to load | Type to filter...
>  cjpais/llava-1.6-mistral-7b-gguf/llava-v1.6-mistral-7b.Q8_0.gguf (7.70 GB)

Only one model is listed--same as in he GUI

Swicegood avatar Jul 28 '24 19:07 Swicegood