Create WebLLM app - local running LLMs

[Marak]

https://github.com/mlc-ai/web-llm https://chat.webllm.ai/

web-llm has a good start for running large language models in the browser.

It would be great if we can add this to Buddy Pond such that we have an App specifically designed for running local LLMs

It should be trivial to create an iframe based Buddy Pond app that hosts https://chat.webllm.ai/

For more control, it should be relatively easy to build the https://github.com/mlc-ai/web-llm project and vendor the dependencies into an App that runs entirely hosted on Buddy Pond.

Pull requests are welcomed! We can reward you with Good Buddy Points from the Buddy Coin ecosystem.