gptme icon indicating copy to clipboard operation
gptme copied to clipboard

Some tools not well used with BREAK_ON_TOOLUSE=false

Open ErikBjare opened this issue 9 months ago • 8 comments

I was testing deepseek/deepseek-reasoner with GPTME_BREAK_ON_TOOLUSE=false and it didn't use the right tmux session because it proposed 4 commands in one go, but it needed the output of the first command (session id) to use the others, so it hallucinated a bad id which got the wrong tmux session contents.

Includes all non-streaming usage as well, since the behavior is equivalent to BREAK_ON_TOOLUSE=false.

This might be partly caused by prompting that it will immediately get responses to all tooluses, which isn't true when BREAK_ON_TOOLUSE=false or --no-stream.

Also just an idea: We could force the break on tooluse in the non-streaming API by simply stripping everything after and pretend we didn't get it, but it would waste a lot of tokens.

ErikBjare avatar Jan 24 '25 15:01 ErikBjare