SillyTavern icon indicating copy to clipboard operation
SillyTavern copied to clipboard

[BUG] SillyTavern aborts the message generation process when the browser window is inactive

Open vfnm opened this issue 1 year ago • 5 comments

Warning. Complete all the fields below. Otherwise your bug report will be ignored!

Have you searched for similar bugs? Yes

Describe the bug I use ST with my Poe API Server for story writing and when I use a very high context size, the message can take quite some time, which is why I leave the browser app (when using ST on my smartphone). Often times ST then cancels the current message generation process and the message gets lost.

Expected behavior I would expect that the message generation would still happen in the background.

Desktop (please complete the following information):

  • OS/Device: Android when using ST, while the server itself is hosted on a Docker instance
  • Browser Chrome

vfnm avatar Aug 02 '23 21:08 vfnm

Same trouble. If I open SillyTavern at remote device (PC or Laptop) I have same problem if I switch to another window or tab

submaroon avatar Oct 30 '23 13:10 submaroon

@SubMaroon Need more info about your API/model and setup.

Cohee1207 avatar Oct 30 '23 14:10 Cohee1207

@SubMaroon Need more info about your API/model and setup.

The last SillyTavern and oogabooga web-ui SillyTavern looks into the internet via keenetic DDNS/ Remote hosts - Ubuntu and Android 70% - abort It's strange behavior. Is SillyTavern connect to web-ui permanently or when it POST and GET a queries only?

submaroon avatar Oct 30 '23 14:10 submaroon

Not permanently, only on requests to generation, and your tunneling method could interrupt long-running connections to oobabooga. There's no timeout for requests that ST makes to oobabooga, but there were numerous cases of remote hosts abrupting connections that take longer than 30 seconds. There's nothing we can do from the ST side regarding that, please look at the configuration of your remote connections.

Cohee1207 avatar Oct 30 '23 14:10 Cohee1207

Thanks! I'll think to resolve a trouble

submaroon avatar Oct 30 '23 14:10 submaroon