amica icon indicating copy to clipboard operation
amica copied to clipboard
verified publisher icon semperai

Support Text-Generation-WebUI

Open jobobby04 opened this issue 2 years ago • 1 comments

I mainly use exl2 models since they allow better performance for local models, and the Text-Generation-WebUI is the best option for running them locally.

jobobby04 avatar Dec 07 '23 21:12 jobobby04

It does just not natively. check support docs, works for me in OPENAI API mode. See support documentation here: https://docs.heyamica.com/guides/using-oobabooga

pyrater avatar Dec 19 '23 09:12 pyrater