mlc-llm
mlc-llm copied to clipboard
How to stop a stream?
Hi Web-LLM team, can't say I have had this much fun in years. My demo is here
https://hpssjellis.github.io/my-examples-of-ai-agents/public/web-llm/deepseek-r1-00.html
I want to stop and restart a stream mid chat. I can't find a myEngine.abort() and I don't want to unload and reload the model. Any suggestions?
P.S. My demo above works online but also if you right-click -->view page source and download the HTML page and load the page and model with WiFi and then work fully offline. Amazingly fun. Well done everyone.
Jeremy ellis