Retrochat-v2 icon indicating copy to clipboard operation
Retrochat-v2 copied to clipboard

Oobabooga support for local generations?

Open hexive opened this issue 6 months ago • 5 comments

Any chance you'd consider adding Oobabooga support as a provider? https://github.com/oobabooga/text-generation-webui

They have an API that is "drop in compatible" with OpenAI so maybe it wouldn't be too much work?

Retrochat is a super fun tool. Thanks for putting it out there. I'm using it mostly with ollama, but there are some models that run better and faster locally with ooba.

hexive avatar Aug 13 '24 20:08 hexive