web-llm icon indicating copy to clipboard operation
web-llm copied to clipboard
verified publisher icon mlc-ai

[feature request] Please allow to upload a model.

Open 0wwafa opened this issue 1 year ago • 1 comments

In your demo page (which would be nicer as a web app (PWA) you have a list of models.. and that's ok... But if like in my case, someone has a slow connection and already has some models downloaded in gguf format, it would be nice to just "upload them" (i.e. load from disk) and try them out.

0wwafa avatar May 24 '24 16:05 0wwafa

For the record, https://github.com/mlc-ai/web-llm/tree/main/examples/simple-chat-upload is an example of supporting local model in the app

CharlieFRuan avatar May 26 '24 08:05 CharlieFRuan

For the record, https://github.com/mlc-ai/web-llm/tree/main/examples/simple-chat-upload is an example of supporting local model in the app

For the record, https://github.com/mlc-ai/web-llm/tree/main/examples/simple-chat-upload is an example of supporting local model in the app

I checked it but I don't get it... sorry

0wwafa avatar May 29 '24 19:05 0wwafa

Thanks @CharlieFRuan for the reference.

@0wwafa Since this is for the webapp instead of the engine, I'll close this issue and create another at https://github.com/mlc-ai/web-llm-chat/issues/23 . Please feel free to follow up there.

Neet-Nestor avatar May 31 '24 04:05 Neet-Nestor