quantum

why do labels have to be reassigned to their original labels at each iteration in filter_relabel `train_batch_data = self.train_dl.dataset` `for i in range(len(train_batch_data)):` `train_batch_data[i][-1][:] = self.ori_train_labels[i]` `self.train_dl = DataLoader(train_batch_data, batch_size=self.batch_size,...

使用baichuan-7b评估humaneval数据与榜单差距过大

2

### 先决条件 - [X] 我已经搜索过 [问题](https://github.com/open-compass/opencompass/issues/) 和 [讨论](https://github.com/open-compass/opencompass/discussions) 但未得到预期的帮助。 - [X] 错误在 [最新版本](https://github.com/open-compass/opencompass) 中尚未被修复。 ### 问题类型 我正在使用官方支持的任务/模型/数据集进行评估。 ### 环境 {'CUDA available': True, 'CUDA_HOME': '/usr/local/cuda', 'GCC': 'gcc (Ubuntu 9.4.0-1ubuntu1~20.04.1) 9.4.0', 'GPU...