web-llm
web-llm copied to clipboard
mlc-ai
Add ability to stop it before finishing to write a prompt
What do you mean? Like a "stop generate" button to enable early stopping?
Exactly!
On Wed, Apr 19, 2023 at 12:23 AM Hongyi Jin @.***> wrote:
What do you mean? Like a "stop generate" button to enable early stopping?
— Reply to this email directly, view it on GitHub https://github.com/mlc-ai/web-llm/issues/41#issuecomment-1513811038, or unsubscribe https://github.com/notifications/unsubscribe-auth/AARZC53657LOKNCWS7KFHSLXB4A55ANCNFSM6AAAAAAXDEVBUY . You are receiving this because you authored the thread.Message ID: @.***>
-- Florin Badita Founder, Corruption Kills TEDx Speaker | Forbes 30 Under 30 Europe | Senior Landecker Democracy Fellow Book a time to have a small chat https://calendly.com/florinbadita/small-chat
That would be great, really. At present, since webLMM cannot be interrupted while generating a response, I can only continue to watch until it finishes.
The latest webllm js api contains a interrupt function that can support this
