MM-Vet
MM-Vet copied to clipboard
MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities
Hi! Link for leadervord for v2 pointed to paperswithcode.com is 404.
Hi there, Congrats on your work. I discovered it through the paper page: https://huggingface.co/papers/2408.00765. I see the paper already has a linked Space, it would be great to also make...
Currently, during regular times when there are only a few people in the queue, the online evaluator (https://huggingface.co/spaces/whyu/MM-Vet_Evaluator) may take several hours to start processing an evaluation. This is excessively...
paperwithcode was shut down :(
When I try to run mm-vet_evaluator.ipynb locally (using my own openai api key) the eval process keep sleeping like that: