text-generation-webui icon indicating copy to clipboard operation
text-generation-webui copied to clipboard

Gradio API Chat Compatibility

Open bmoconno opened this issue 2 years ago • 0 comments

I've seen a lot of people trying to figure out how to keep all the good parts (context, stopping strings, etc...) of the chat modes, while also being able to access it via the non-KoboldAI API (#1002, #656, and in the un-official Discord)... so I made this.

I've done some testing, and this seems functional, I'm putting this PR in for people to look at and review the changes.

Characters must be selected via the UI, I have a PR out for loading a character via command args (#976) but that's been sitting for a while and needs to be updated... someone also suggested a change that I like, so I'll be working on that next.

bmoconno avatar Apr 15 '23 23:04 bmoconno