text-generation-webui
text-generation-webui copied to clipboard
Add "Continue answer" button for chats
I'm trying to get more refined response but it seems impossible. Tried to replace last replay and sending empty message but it's interpreted as negative silence. In the end I want to give bot some kind of starting context on how to respond.
Continue button could also be used to simply generate longer answer.
Another way I can think of implementing it would be ability to remove input name when sending question. That way I could replace "You:" with "Bot:" or nothing and send empty message.
2nd solution is a bit more flexible as it allows to make bot write second answer or continue its last one.
I could also use api but I don't see a way to copy whole chat with names. Cai-chat has names but copied text has inversed the order (last answer is first message). Exported history format also doesn't work with api.
Is there any way to do it?
I think it might be worth adding a "raw input mode" for chat interface, that the user's input is passed unmodified. This would allow user to do actions and let AI continue, or introduce a third person into the scene. Like "Adventure mode" in other services.
This issue has been closed due to inactivity for 30 days. If you believe it is still relevant, please leave a comment below.
Added here
https://github.com/oobabooga/text-generation-webui/commit/d29f4624e957e52c35d07ffc515a56c440de63c1