zimNMM
zimNMM
I also got this error it seems to be in the chat endpoint.
 If you are using GGUF you have to include the text encoders clip/t5 and the vae
I tried on a cloud instance with 2 GPUs and opened 2 UIs with the flags --devie-id 0 and --device-id 1and both used the CUDA:0 idk if it's a bug....