web-llm icon indicating copy to clipboard operation
web-llm copied to clipboard

Published 20 hours ago • verified publisher icon mlc-ai

Change the system message

Open tobowers opened this issue 1 year ago • 1 comments

I discussed this in Discord.

I would like a way to change the system message after doing a completion. Right now the only way to do that is to trigger a full reload which does the entire model download again, etc.

tobowers avatar Jul 04 '23 11:07 tobowers

+1 to this - it would be very useful to not have to reload the model from cache!

jparismorgan avatar Jul 13 '23 12:07 jparismorgan

this is now supported

tqchen avatar May 31 '24 21:05 tqchen