opencompass

opencompass copied to clipboard

Thanks for your contribution and we appreciate it a lot. The following instructions would make your pull request more healthy and more easily get feedback. If you do not understand...

sudanl

### Describe the feature 如题，怎么指定livecodebench 为v5 ### Will you implement it? - [ ] I would like to implement this feature and create a PR!

Haruka1307

[Bug] 测试 Claude 调用API失败

3

### 先决条件 - [x] 我已经搜索过 [问题](https://github.com/open-compass/opencompass/issues/) 和 [讨论](https://github.com/open-compass/opencompass/discussions) 但未得到预期的帮助。 - [x] 错误在 [最新版本](https://github.com/open-compass/opencompass) 中尚未被修复。 ### 问题类型 我正在使用官方支持的任务/模型/数据集进行评估。 ### 环境 # python -c "import opencompass.utils;import pprint;pprint.pprint(dict(opencompass.utils.collect_env()))" {'CUDA available': False, 'GCC': 'gcc...

hongmingzhang8

[Bug] Deepseek 升级deepseek-v3.1-terminus后，为何调用ksyun的DS API失败

2

### Prerequisite - [x] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expected help. - [x] The bug has not been fixed in the [latest version](https://github.com/open-compass/opencompass). ### Type...

hongmingzhang8

[Bug] Qwen3-8B的gsm8k只有34分，比官网技术报告的89.4差了很多

2

### Prerequisite - [x] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expected help. - [x] The bug has not been fixed in the [latest version](https://github.com/open-compass/opencompass). ### Type...

YuCheng-Qi

[Bug] 安装失败

1

### 先决条件 - [x] 我已经搜索过 [问题](https://github.com/open-compass/opencompass/issues/) 和 [讨论](https://github.com/open-compass/opencompass/discussions) 但未得到预期的帮助。 - [x] 错误在 [最新版本](https://github.com/open-compass/opencompass) 中尚未被修复。 ### 问题类型 我正在使用官方支持的任务/模型/数据集进行评估。 ### 环境 python 3.12 ### 重现问题 - 代码/配置示例 ` pandas-1.5.3.tar.gz (5.2 MB) Installing...

ioir123ju

How to specify the saving path of output directory

1

### Describe the feature ✔ I've checked issues and discussions. I want to ask whether opencompass accepts a config parameter that specifies the output directory where prediction, logs and summary...

jerryliang24

[Feature] support tablebench

1

### Describe the feature 如题，可以支持tablebench的测评吗 ### Will you implement it? - [ ] I would like to implement this feature and create a PR!

Haruka1307

### 先决条件 - [x] 我已经搜索过 [问题](https://github.com/open-compass/opencompass/issues/) 和 [讨论](https://github.com/open-compass/opencompass/discussions) 但未得到预期的帮助。 - [x] 错误在 [最新版本](https://github.com/open-compass/opencompass) 中尚未被修复。 ### 问题类型 我正在使用官方支持的任务/模型/数据集进行评估。 ### 环境 L20 `conda create --name opencompass python=3.10 conda activate opencompass git clone...

wenba0

## Overview This PR refactors the backend switch logic in OpenCompass to provide better support for multiple inference backends with a cleaner, more maintainable architecture. The refactoring expands backend support...

Copilot