web-llm icon indicating copy to clipboard operation
web-llm copied to clipboard

Loading models from disk

Open bakkot opened this issue 1 year ago • 0 comments

I would like more control over where model files live on disk. It would be nice to be able to load files from disk instead of from the web. (I previously suggested this for web-stable-diffusion.)

For implementing this, the drag-and-drop API gives you a File, and those can be used with createObjectURL to get a URL, so the only behind-the-scenes change necessary would be for TVM not to use the cache when reading blob: URLs (so as not to double the disk usage). Then you just need a little bit of UI.

bakkot avatar Jan 31 '24 20:01 bakkot