Hi, I made a new website for web-llm!

[Ryan-yang125]

Hi there!

I want to share that I've been enjoying using web-llm and its demo for some time now. However, I found that the demo didn't quite meet my needs for more in-depth usage. As a result, I decided to create a new app based on web-llm, which now functions as a fully-realized chat app!

Here is my project ChatLLM-Web , which supports:

• ⚙️ Model runs in a web worker, ensuring that it doesn't block the user interface and providing a seamless experience.
• 🚀 Easy to deploy for free with one-click on Vercel in under 1 minute, then you get your own ChatLLM Web.
• 💬 Multi-conversation chat, with all data stored locally in the browser for privacy.
• 📝 Markdown and streaming response support: math, code highlighting, etc.
• 🎨 responsive and well-designed UI, including dark mode.

Here is a screenshot of it:

Hope this will help web-llm 😊！

[Ryan-yang125]

Also, I would like to express my gratitude to @DustinBrett! I was able to reference your initial commit to load web-llm in a web worker and reimplement it for my own project. Your work on daedalOS is truly impressive, and I must say it's the most remarkable desktop environment I've ever seen in a browser. Keep up the great work!

[DustinBrett]

Also, I would like to express my gratitude to @DustinBrett! I was able to reference your initial commit to load web-llm in a web worker and reimplement it for my own project. Your work on daedalOS is truly impressive, and I must say it's the most remarkable desktop environment I've ever seen in a browser. Keep up the great work!

Thanks very much @Ryan-yang125! Your project looks very cool, I may have to get some inspiration for my AI Chat program from it, especially for things like the markdown formatting as mine is currently quite basic. WebLLM is an amazing project and it's exciting integrating it into our projects. I'd still like to add so many things such as STT/TTS and an entire AI assistant for my desktop environment similar to Cortana but hopefully smarter and more useful. I could see this being quite powerful as we start to get better models, although Vicuna 7B is already rather impressive. Good luck!