mlc-llm icon indicating copy to clipboard operation
mlc-llm copied to clipboard

How to stop a stream?

Open hpssjellis opened this issue 9 months ago • 8 comments

Hi Web-LLM team, can't say I have had this much fun in years. My demo is here

https://hpssjellis.github.io/my-examples-of-ai-agents/public/web-llm/deepseek-r1-00.html

I want to stop and restart a stream mid chat. I can't find a myEngine.abort() and I don't want to unload and reload the model. Any suggestions?

P.S. My demo above works online but also if you right-click -->view page source and download the HTML page and load the page and model with WiFi and then work fully offline. Amazingly fun. Well done everyone.

Jeremy ellis

hpssjellis avatar Jan 30 '25 00:01 hpssjellis