LLaVA-NeXT icon indicating copy to clipboard operation
LLaVA-NeXT copied to clipboard

What is the purpose of the 3 three sh files in script/interleave since we can evaluate using lmms-eval

Open Haodi-Liu opened this issue 1 year ago • 0 comments

Dear authors,

Thanks for your remarkable work! I'd like to evaluate the LLaVa-OV model on different datasets. So I spotted the three bash files (eval_all.sh, eval_interleave_3d.sh and eval_multiprocess.sh) in scripts/interleave and regarded them as evalution scripts.

However, I also noticed lmms-eval in the following md https://github.com/LLaVA-VL/LLaVA-NeXT/blob/main/docs/LLaVA_OneVision.md

Which is the right way to evaluate the model? lmms-eval or three bash files? What are the purposes of each option?

Any feedback is appreciated! Thanks in advance.

Haodi-Liu avatar Sep 21 '24 05:09 Haodi-Liu