react-llm
react-llm copied to clipboard
r2d4
Easy-to-use headless React Hooks to run LLMs in the browser with WebGPU. Just useLLM().
Hi, Thanks for the amazing project! I'm currently trying to adapt `react-llm` to work with a Llama2 variant I've quantized and transformed to wasm using the [MLC AI LLM library](https://mlc.ai/mlc-llm/docs/compilation/compile_models.html)...
https://chat.matt-rickard.com/ shows this error: ``` Sorry, unsupported! Reason: e.requestAdapterInfo is not a function [react-llm](http://github.com/react-llm) runs models in the browser with WebGPU and only works in Google Chrome v113 and above...
