opencompass
opencompass copied to clipboard
longbench_vcsum找不到data_files
Prerequisite
- [X] I have searched Issues and Discussions but cannot get the expected help.
- [X] The bug has not been fixed in the latest version.
Type
I'm evaluating with the officially supported tasks/models/datasets.
Environment
conda create --name opencompass python=3.10 pytorch torchvision pytorch-cuda -c nvidia -c pytorch -y conda activate opencompass git clone https://github.com/open-compass/opencompass opencompass cd opencompass pip install -e .
Reproduces the problem - code/configuration sample
python run.py --models hf_llama3dot1_8b_instruct --datasets longbench_vcsum_gen --debug
Reproduces the problem - command or script
python run.py --models hf_llama3dot1_8b_instruct --datasets longbench_vcsum_gen --debug
Reproduces the problem - error message
File "/home/ubuntu/opencompass/run.py", line 4, in
Other information
找不到longbench_vcsum对应的data_files。