llm icon indicating copy to clipboard operation
llm copied to clipboard
verified publisher icon rustformers

Use mlc-llm as backend

Open shiqimei opened this issue 2 years ago • 1 comments

https://github.com/mlc-ai/mlc-llm

shiqimei avatar May 11 '23 16:05 shiqimei

MLC is very cool, but I'm not sure how much effort it would be to integrate. We'll have to implement support for custom backends first (#31).

philpax avatar May 11 '23 22:05 philpax