Jeffser
Add a "story mode"
Is your feature request related to a problem? Please describe. KoboldAI provides a "Story Mode", which - unlike the Chat Mode common in most LLM front ends - provides a single, editable, continuous text field. My problem with Chat Mode is, that I often require an LLM to continue an already existing text and the ability to quickly edit or re-generate the LLM's text continuation. - Rather than the back-and-forth between user and LLM in Chat Mode.
Describe the solution you'd like Implement a story/notebook mode, that a) provides a single, editable text field where the LLM can append text at the end of the already existing text b) provides a "Generate More" button that prompts the LLM to append text to the existing text c) allows the user to edit, remove, add, copy, cut and paste text within the entire body of the text field, by moving a cursor to the relevant section, like in a generic text editor d) provides a "Retry" button that deletes the latest block of text generated by the LLM and then, once again, prompts the LLM to append text to the existing text
Additional context Example screenshot of KoboldAI's Story Mode with sample text. The option "Allow Editing" is activated in the bottom-right corner, which allows the user to place a cursor in the text to edit it. Part of the text - beginning with "I am searching for knowledge" - has a slightly blue colour, to signal that this was the latest block of text generated by the LLM. Clicking the "Retry" button would remove this text and prompt the LLM to generate alternative text.
Sounds interesting, I'll look into it once I get some free time.
Do you think this should be a special chat or a separate page (like the model manager)?
A special chat would be the best solution. Probably by changing the "New Chat" button into a SplitButton with a drop-down option for "New Story" or "New Notebook" - depending on how you'd want to name it.
This way the user could manage all chats and stories in the same sidebar.
I decided to try to make this the big feature for Alpaca 7, so probably in a couple of months.
I think this is a great feature and I could make some cool stuff with it.
Like you said this should probably be a special type of chat, it should have 2 tabs, one shows all the user messages and the other one the notebook. The user should be able to go to a previous state of the notebook by selecting a specific message in the first tab.
Of course the notebook should be exportable as a markdown too.
I know I said Alpaca 7 but this has proven more difficult than I thought, so I'll push it over to Alpaca 8