Request option: Change maximum output

[Sarrusha]

Hello, I love this program. I am using Windows, and it works beautifully local with Kobodcpp. However, I encountered a hard limit: when the input is very long, and I know it is correctly processed in the terminal in the background, the generated output is limited to just 512 tokens. This happens whether I swap the old text in place with the output or use the option of opening a new window in the widget, especially when generating longer output.

What I would like is an option to change the maximum number of tokens, perhaps up to 2048 or more. I find the 512-token limit too restrictive. Thanks.

Example Now: Generating (233 / 512 tokens) Hoped: Generating (233 / 2048 tokens)

[theJayTea]

I'll take a look at this! Maybe I'll make the max token limit user-configurable (PS: with Gemini, it currently supports a 1000 token output).

[VL4DST3R]

+1 would like to set this as well!

[theJayTea]

Gonna add this to the todo list, this is trivial to improve :)

Not gonna be able to roll out the update within the next 30 days due to interview prep and exams, but after that i'll be full time on Writing Tools again!