aiconfig icon indicating copy to clipboard operation
aiconfig copied to clipboard

[editor][server] aiconfig_chunk incorrect outputs when updating prompt input while stream is running

Open rholinshead opened this issue 1 year ago • 0 comments

I've noticed the following scenario:

  • Run a prompt, see the output being streamed
  • Change the prompt input while it's streaming, e.g. just add a space in the text
  • This results in the output stream being broken, with some of the new outputs being shown and then removed

Debugging, I can see that aiconfig_chunk doesn't have the correct outputs in this scenario, while the latest output_chunk does.

See video with logging in LocalEditor streamingApiChain callbacks:

https://github.com/lastmile-ai/aiconfig/assets/5060851/5a5faa2b-1f1f-4b6f-bdb2-85e6f3a9b51c

rholinshead avatar Jan 18 '24 16:01 rholinshead