opencompass icon indicating copy to clipboard operation
opencompass copied to clipboard

longbench_vcsum找不到data_files

Open DXFFFFFF opened this issue 6 months ago • 1 comments

Prerequisite

Type

I'm evaluating with the officially supported tasks/models/datasets.

Environment

conda create --name opencompass python=3.10 pytorch torchvision pytorch-cuda -c nvidia -c pytorch -y conda activate opencompass git clone https://github.com/open-compass/opencompass opencompass cd opencompass pip install -e .

Reproduces the problem - code/configuration sample

python run.py --models hf_llama3dot1_8b_instruct --datasets longbench_vcsum_gen --debug

Reproduces the problem - command or script

python run.py --models hf_llama3dot1_8b_instruct --datasets longbench_vcsum_gen --debug

Reproduces the problem - error message

File "/home/ubuntu/opencompass/run.py", line 4, in [rank0]: main() [rank0]: File "/home/ubuntu/opencompass/opencompass/cli/main.py", line 308, in main [rank0]: runner(tasks) [rank0]: File "/home/ubuntu/opencompass/opencompass/runners/base.py", line 38, in call [rank0]: status = self.launch(tasks) [rank0]: File "/home/ubuntu/opencompass/opencompass/runners/local.py", line 123, in launch [rank0]: task.run(cur_model=getattr(self, 'cur_model', [rank0]: File "/home/ubuntu/opencompass/opencompass/tasks/openicl_infer.py", line 79, in run [rank0]: self.dataset = build_dataset_from_cfg(self.dataset_cfg) [rank0]: File "/home/ubuntu/opencompass/opencompass/utils/build.py", line 13, in build_dataset_from_cfg [rank0]: return LOAD_DATASET.build(dataset_cfg) [rank0]: File "/home/ubuntu/miniconda3/envs/opencompass/lib/python3.10/site-packages/mmengine/registry/registry.py", line 570, in build [rank0]: return self.build_func(cfg, *args, **kwargs, registry=self) [rank0]: File "/home/ubuntu/miniconda3/envs/opencompass/lib/python3.10/site-packages/mmengine/registry/build_functions.py", line 121, in build_from_cfg [rank0]: obj = obj_cls(**args) # type: ignore [rank0]: File "/home/ubuntu/opencompass/opencompass/datasets/base.py", line 12, in init [rank0]: self.dataset = self.load(**kwargs) [rank0]: File "/home/ubuntu/opencompass/opencompass/datasets/longbench/longbench_vcsum.py", line 14, in load [rank0]: kwargs['data_files'] = get_data_path(kwargs['data_files'], [rank0]: KeyError: 'data_files'

Other information

找不到longbench_vcsum对应的data_files。

DXFFFFFF avatar Aug 07 '24 03:08 DXFFFFFF