llm
llm copied to clipboard
Use mlc-llm as backend
https://github.com/mlc-ai/mlc-llm
MLC is very cool, but I'm not sure how much effort it would be to integrate. We'll have to implement support for custom backends first (#31).