mlc-ai
New demo not working
The new landing page design is so much nicer, well done!
It's not loading for me though:
Mac OS Brave
@flatsiedatsie Thank you so much for reporting the issue. It seems GitHub pages doesn't give proper CSP header required to run the demo webapp. We will work on a fix asap.
A fix has been pushed https://github.com/mlc-ai/web-llm-chat/commit/2b66d04cee53ab31bc577ce725fb610bc96a132f and deployed.
@flatsiedatsie Could you please try visiting https://chat.webllm.ai and let me know if it loads correctly for you this time?
It's still not working for me. I deleted the site cache and did a hard reload.
(Brave shields are disabled)
off topic: it would be nice if you could keep Google out of it?
This is weird as in your screenshot, the CSP is still set as worker-src 'none' even though we have updated it to allows 'self'. Could you please confirm whether you are using some kind of browser extension that rewrites CSP and blocks service workers from loading? Would you like to try loading the app with some extensions disbled?
For background context, we are currently using worker threads in the new demo page so that you don't need to initialize the models again and again in multiple page loads. However, if you prefer workers to be disabled, we can work on a fallback to vanilla WebLLM engine.
(side-note: Google analytics was used to collect exceptions internally before releasing. It has been removed from the site now. I will work on replace Google fonts API with local fonts too.)
Google fonts API also removed.
For the CSP issue, it seems like not a really issue but just a report-only warning. Therefore, it should not prevent your page loading.
Still not sure why service worker isn't available in your case, but I make a PR to fall back to web worker if it is unavailable. https://github.com/mlc-ai/web-llm-chat/commit/3cd1201ead340f246618919d485038e381abebb7
@flatsiedatsie Could you please make sure you toggle off this option "forbid web workers" in uMatrix extension and try agian?
I tested again.
- did a full browser cache clear first.
- uMatrix is off (and forbid webworkers is not enabled, as my own project uses them too)
- uBlock origin is off
- Brave shields is off
- Decentraleyes has no effect on this site
It's now stuck on downloading.
CTRL-F5
and now I see:
To my surprise it's once again stuck on 20%, and seems to have jumped there immediately.
odd, the download (of a different model, just to avoid any issues there).. got stuck again.
I just tried again. This time the model loaded fully, and everything works.
Thanks for confirming. As the loading was successfully initialized but stuck in the middle and there were no error, I guess it was about Internet connection and slow download speed. Thanks for confirming that it's working for you now.