VLMEvalKit icon indicating copy to clipboard operation
VLMEvalKit copied to clipboard

Wrong download link for R-Bench

Open ZTWHHH opened this issue 6 months ago • 0 comments

The download inks in vlmeval/dataset/image_mcq.py for R-Bench are wrong, they download an html page instead of tsv file:

# R-Bench
'R-Bench-Dis': 'https://huggingface.co/datasets/lcysyzxdxc/R-Bench/blob/main/R-bench-dis.tsv',
'R-Bench-Ref': 'https://huggingface.co/datasets/lcysyzxdxc/R-Bench/blob/main/R-bench-ref.tsv',

The correct link should be

# Correct R-Bench
'R-Bench-Dis': 'https://huggingface.co/datasets/lcysyzxdxc/R-Bench/resolve/main/R-bench-dis.tsv',
'R-Bench-Ref': 'https://huggingface.co/datasets/lcysyzxdxc/R-Bench/resolve/main/R-bench-ref.tsv',

ZTWHHH avatar Jul 10 '25 01:07 ZTWHHH