TinyLLaVA_Factory icon indicating copy to clipboard operation
TinyLLaVA_Factory copied to clipboard

Published 20 hours ago • verified publisher icon TinyLLaVA

Reproduced results

Open Fantasy1120 opened this issue 8 months ago • 3 comments

I try to reproduce the results under base recipe. I basically get the results in the paper on VQAv2, GQA, ScienceQA and POPE. But there is almost 1% gap on TextVQA, MMMU, and MM-Vet, and the gap on MME seems to be larger. I'm not sure if this gap is acceptable? Or what could potentially cause this gap? reproduce

Fantasy1120 avatar Jun 14 '24 09:06 Fantasy1120