opencompass
opencompass copied to clipboard
[Feature] 添加mlc-llm后端支持
描述该功能
我注意到opencompass已经为lmdeploy和vllm提供支持,能否支持使用mlc-llm进行推理? https://github.com/mlc-ai/mlc-llm
是否希望自己实现该功能?
- [ ] 我希望自己来实现这一功能,并向 OpenCompass 贡献代码!
We can consider adding this to our backlog, @liushz.
We can consider adding this to our backlog, @liushz.
thanks a lot