MM-Vet icon indicating copy to clipboard operation
MM-Vet copied to clipboard

MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities

Results 5 MM-Vet issues
Sort by recently updated
recently updated
newest added

Hi! Link for leadervord for v2 pointed to paperswithcode.com is 404.

Hi there, Congrats on your work. I discovered it through the paper page: https://huggingface.co/papers/2408.00765. I see the paper already has a linked Space, it would be great to also make...

Currently, during regular times when there are only a few people in the queue, the online evaluator (https://huggingface.co/spaces/whyu/MM-Vet_Evaluator) may take several hours to start processing an evaluation. This is excessively...

paperwithcode was shut down :(

When I try to run mm-vet_evaluator.ipynb locally (using my own openai api key) the eval process keep sleeping like that: