AndyDev92

How to use Gradio with GGUF model?

3

I was able to install everything successfully on Windows. But I can't load a GGUF model. I entered "openbmb/MiniCPM-o-2_6-gguf" in the model_server.py, but I get an error that no config.json...

How to change the Whisper Model?

1

After 5 hours I finally managed to get coqui to work with the help of chatgpt. Phew, that was a challenge... and it's super fast! Great work! Now there's just...

Ollama not working?

1

I have Ollama running, loaded Ollama 3.1 model and if i input a text prompt i get this error inside the text bar: System: EXCEPTION: Traceback (most recent call last):...