opencompass icon indicating copy to clipboard operation
opencompass copied to clipboard

Published 20 hours ago • verified publisher icon open-compass
→

Metadata

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

Results 261 opencompass issues
Sort by recently updated
recently updated
newest added

[Bug] 0.3.0版本使用tools/case_analyzer.py时，TypeError: 'CMMLUDataset' object is not subscriptable

### 先决条件 - [X] 我已经搜索过 [问题](https://github.com/open-compass/opencompass/issues/) 和 [讨论](https://github.com/open-compass/opencompass/discussions) 但未得到预期的帮助。 - [X] 错误在 [最新版本](https://github.com/open-compass/opencompass) 中尚未被修复。 ### 问题类型 我正在使用官方支持的任务/模型/数据集进行评估。 ### 环境 {'CUDA available': True, 'CUDA_HOME': '/usr/local/cuda', 'GCC': 'gcc (GCC) 8.3.1 20190311 (Red...

nifengcn avatar nifengcn

← Metadata

3.8k
Stars
405
Forks
17
Watchers

Owner

verified publisher icon open-compass

Metadata

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

Back