aiconfig
aiconfig copied to clipboard
[editor][server] aiconfig_chunk incorrect outputs when updating prompt input while stream is running
I've noticed the following scenario:
- Run a prompt, see the output being streamed
- Change the prompt input while it's streaming, e.g. just add a space in the text
- This results in the output stream being broken, with some of the new outputs being shown and then removed
Debugging, I can see that aiconfig_chunk doesn't have the correct outputs in this scenario, while the latest output_chunk does.
See video with logging in LocalEditor streamingApiChain
callbacks:
https://github.com/lastmile-ai/aiconfig/assets/5060851/5a5faa2b-1f1f-4b6f-bdb2-85e6f3a9b51c