gptme
gptme copied to clipboard
Some tools not well used with BREAK_ON_TOOLUSE=false
I was testing deepseek/deepseek-reasoner with GPTME_BREAK_ON_TOOLUSE=false and it didn't use the right tmux session because it proposed 4 commands in one go, but it needed the output of the first command (session id) to use the others, so it hallucinated a bad id which got the wrong tmux session contents.
Includes all non-streaming usage as well, since the behavior is equivalent to BREAK_ON_TOOLUSE=false.
This might be partly caused by prompting that it will immediately get responses to all tooluses, which isn't true when BREAK_ON_TOOLUSE=false or --no-stream.
Also just an idea: We could force the break on tooluse in the non-streaming API by simply stripping everything after and pretend we didn't get it, but it would waste a lot of tokens.