MM-Vet icon indicating copy to clipboard operation
MM-Vet copied to clipboard

Online Evaluator is Significantly Slower Than Before

Open pspdada opened this issue 8 months ago • 1 comments

Currently, during regular times when there are only a few people in the queue, the online evaluator (https://huggingface.co/spaces/whyu/MM-Vet_Evaluator) may take several hours to start processing an evaluation. This is excessively long and has become a bottleneck for users. Additionally, once the evaluation starts, it takes approximately 20 minutes to complete all the data, which feels unusually slow compared to previous experiences where the process was much faster.

Could you please investigate what might be causing this slowdown?

Image

pspdada avatar Apr 05 '25 12:04 pspdada

Same issue. The evaluation process is much slower than before.😭

Theia-4869 avatar Apr 05 '25 19:04 Theia-4869