text-generation-webui
text-generation-webui copied to clipboard
Gradio API Chat Compatibility
I've seen a lot of people trying to figure out how to keep all the good parts (context, stopping strings, etc...) of the chat modes, while also being able to access it via the non-KoboldAI API (#1002, #656, and in the un-official Discord)... so I made this.
I've done some testing, and this seems functional, I'm putting this PR in for people to look at and review the changes.
Characters must be selected via the UI, I have a PR out for loading a character via command args (#976) but that's been sitting for a while and needs to be updated... someone also suggested a change that I like, so I'll be working on that next.