Songyang Zhang

icon indicating a website link https://www.zhangsongyang.com/

icon company Shanghai AI Lab icon location Shanghai icon location Shanghai AI Lab

Results 223 comments of Songyang Zhang

[Bug] Find `scikit-learn` version conflict in `requirements/runtime.txt` and `requirements/extra.txt`

Thanks for the report. We will fix this conflict in next version.

[Bug] TurboMindModelwithChatTemplate中tm_model变量可能未初始化导致报错

Thanks for the report, we will add this promblem into our backlog. For prompt viewer, you can use the HF version model configuration.

[Bug] mmlu_pro结果正则提取出错

Thanks for your report, we will check this bug and reply soon.

[Bug] mmlu_pro结果正则提取出错

Can you provide a running command for this bug?

[Feature] 请问使用API评测如何支持自定义数据集？

You can change the models with the API models.

[Bug] livecodebench evaluator may need to check the memory footprint

Thank you. Would you be interested in creating a pull request to enhance this?

[Bug] 使用deepseek-v2-lite-chat进行humaneval测试时，出现问题，无论是在官网还是本地部署测试分数只有1.22，其他模型都正常

Thank you for the report. We will investigate this issue.

[Bug] model-kwargs参数和generation-kwargs参数无法通过CLI命令行指定

Thanks for your question, we will fix this issue.

updates the dependency `PyExt` for python3.11\3.12 support

Please fix the lint issue

updates the dependency `PyExt` for python3.11\3.12 support

Hi, would you like to update for resolving the lint issue?