FastChat
FastChat copied to clipboard
Does FastChat consider AbortController?
trafficstars
During the streaming output process, does FastChat consider stopping the token output after the frontend disconnects using AbortController ? If so, could you please let me know where the code is located? Thank you very much!
流式输出过程中,FastChat 是否考虑前端使用 AbortController 断开连接之后停止输出 token 呢?如果有的话,请问一下代码在哪个位置,非常感谢!