Dmitry Torokhov
Results
3
comments of
Dmitry Torokhov
There is initial token calculation over the entire old prompt (loaded from history) that has to happen. If we just "debounce" it then there will be a pause in the...
Right, this is the initial computation that gets you. The costliest operation there is scanning and updating previous chat history, and it is currently pretty inefficient. You can try "history-handling"...
Honestly I would simply remove the logo altogether...