Akaash Parthasarathy

icon indicating a website link akaashrp.github.io

icon company Carnegie Mellon University icon location Pittsburgh, PA icon location Systems hard. Must work harder.

Results 3 comments of Akaash Parthasarathy

Error: can't register atexit after shutdown

Also running into the same issue

Any distributed capabilities planned?

Hi @lonnietc, there's currently no plan to support distributed inference across multiple clients. WebLLM is intended to run in your browser and utilize the WebGPU abstraction provided by the browser.

Wasm file generating but not compatibility issue.

Hi, this should be fixed in version 0.2.80. If you checkout to the TVM and MLC-LLM commits listed in https://github.com/mlc-ai/web-llm/pull/747, you should be able to compile without issues. Please ping...