opencompass

opencompass copied to clipboard

[Bug] 微调过的Qwen2.5-7b输出全是感叹号/The output of fine-tuning Qwen2.5-7b is '！！！！！！'

12

### Prerequisite - [X] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expected help. - [X] The bug has not been fixed in the [latest version](https://github.com/open-compass/opencompass). ### Type...

noname342

### Describe the feature METRIC_WHITELIST怎么添加白名单 ### Will you implement it? - [ ] I would like to implement this feature and create a PR!

xming521

Thanks for your contribution and we appreciate it a lot. The following instructions would make your pull request more healthy and more easily get feedback. If you do not understand...

epsilondylan

### Describe the feature When using a Hugging Face model with the parameter num_return_sequences set greater than 1, the output column “predictions” becomes a list instead of a string. As...

DELEnomore

[Feature] is there any way to evaluate an agent?

1

### 描述该功能 is there any way to evaluate an agent? btw how to use transbench? ### 是否希望自己实现该功能？ - [ ] 我希望自己来实现这一功能，并向 OpenCompass 贡献代码！

SamYuan1990

[Feature] MindSpore framework support for OpenCompass

1

### Describe the feature # Motivation Currently, PyTorch is the only supported framework for OpenCompass. We would like to propose supporting different frameworks such as MindSpore on Ascend NPU in...

linhan37

[Bug] why "pred" is "NULL"？ why accuracy is 0 ？

2

### Prerequisite - [x] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expected help. - [x] The bug has not been fixed in the [latest version](https://github.com/open-compass/opencompass). ### Type...

sankexin

[Feature] The model evaluation is too slow, is this option to set enable_thinking=False?

1

### 描述该功能 The model evaluation is too slow. Can we turn off the model thinking to improve the evaluation speed? Is this option available for configuration ### 是否希望自己实现该功能？ - [...

Creammood

### Prerequisite - [x] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expected help. - [x] The bug has not been fixed in the [latest version](https://github.com/open-compass/opencompass). ### Type...

Lizlone

Myhs-phz