lms
lms copied to clipboard
Vision Adapter not loading when model loaded with lms
2024-07-28 15:02:45,079 - ERROR - LLM completion error: Error code: 400 - {'error': '<LM Studio error> Vision model is not loaded. Cannot process images. Suggestion: Make sure to load both the primary and the Vision Adapter models. See more info in https://huggingface.co/collections/lmstudio-ai/vision-models-gguf-6577e1ce821f439498ced0c1. Error Data: n/a, Additional Data: n/a'}
The model is responding just fine to request for image descriptions when run form the GUI.
my model folder llava-1.6-mistral-7b-gguf has two files in it llava-v1.6-mistral-7b.Q8_0.gguf, and mmproj-model-f16.gguf
PS C:\Users\Administrator> lms load --gpu=1.0
I LM Studio is not running in server mode. Starting the server...
I Successfully started the server and verified it is running.
! Use the arrow keys to navigate, type to filter, and press enter to select.
? Select a model to load | Type to filter...
> cjpais/llava-1.6-mistral-7b-gguf/llava-v1.6-mistral-7b.Q8_0.gguf (7.70 GB)
Only one model is listed--same as in he GUI