opencompass

opencompass copied to clipboard

### Describe the feature 请问，opencompass有结果文件可视化分析平台么？ 类似evalScope的[Evalscope Dashboard]， https://evalscope.readthedocs.io/zh-cn/v0.16.3/get_started/visualization.html#id7

cron4y

## 📝 Description Add support for Zebra Grid logic puzzle dataset from allenai/ZebraLogicBench-private with exact ZeroEval alignment. ## 🚀 Features - ZebraGridDataset class for loading HuggingFace datasets - ZebraGridEvaluator with...

max-yue

Thanks for your contribution and we appreciate it a lot. The following instructions would make your pull request more healthy and more easily get feedback. If you do not understand...

Tianhao-Peng

### Prerequisite - [x] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expected help. - [x] The bug has not been fixed in the [latest version](https://github.com/open-compass/opencompass). ### Type...

SaMeTa-cxl

[Bug] 目前只有python3.10版本，3.11啥时候能支持

1

### 先决条件 - [x] 我已经搜索过 [问题](https://github.com/open-compass/opencompass/issues/) 和 [讨论](https://github.com/open-compass/opencompass/discussions) 但未得到预期的帮助。 - [x] 错误在 [最新版本](https://github.com/open-compass/opencompass) 中尚未被修复。 ### 问题类型 我正在使用官方支持的任务/模型/数据集进行评估。 ### 环境 无 ### 重现问题 - 代码/配置示例 无 ### 重现问题 - 命令或脚本 无...

huskyisdog

### Prerequisite - [x] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expected help. - [x] The bug has not been fixed in the [latest version](https://github.com/open-compass/opencompass). ### Type...

qingting-zhxy

### Describe the feature there is opencompass/models/turbomind_api.py but we need also opencompass/models/**vllm_api.py** ### Will you implement it? - [ ] I would like to implement this feature and create a...

barisozcann

### Prerequisite - [x] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expected help. - [x] The bug has not been fixed in the [latest version](https://github.com/open-compass/opencompass). ### Type...

ENg-122

Myhs-phz

[Bug] NPU 运行报错 core dump

2

### 先决条件 - [X] 我已经搜索过 [问题](https://github.com/open-compass/opencompass/issues/) 和 [讨论](https://github.com/open-compass/opencompass/discussions) 但未得到预期的帮助。 - [X] 错误在 [最新版本](https://github.com/open-compass/opencompass) 中尚未被修复。 ### 问题类型 我正在使用官方支持的任务/模型/数据集进行评估。 ### 环境 {'CUDA available': False, 'GCC': 'gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0', 'MMEngine': '0.9.1', 'OpenCV':...

SefaZeng