opencompass icon indicating copy to clipboard operation
opencompass copied to clipboard

[Feature] 添加mlc-llm后端支持

Open XJY990705 opened this issue 1 year ago • 2 comments

描述该功能

我注意到opencompass已经为lmdeploy和vllm提供支持,能否支持使用mlc-llm进行推理? https://github.com/mlc-ai/mlc-llm

是否希望自己实现该功能?

  • [ ] 我希望自己来实现这一功能,并向 OpenCompass 贡献代码!

XJY990705 avatar Sep 05 '24 03:09 XJY990705

We can consider adding this to our backlog, @liushz.

tonysy avatar Sep 05 '24 10:09 tonysy

We can consider adding this to our backlog, @liushz.

thanks a lot

XJY990705 avatar Sep 05 '24 11:09 XJY990705