LLaVA-NeXT icon indicating copy to clipboard operation
LLaVA-NeXT copied to clipboard

Published 20 hours ago • verified publisher icon LLaVA-VL

performance problem of llava-next-video-34b DPO model

Open YoungjaeDev opened this issue 1 year ago • 2 comments

The llava-next-video-34b DPO model is not performing well, whereas the 7B-dpo model works fine.

I've reviewed related issues and tried changing the conv mode to mistral_direct, but the responses still seem off. I also updated IMAGE_TOKEN_INDEX to 64002, but the performance issues persist.

Could you advise on how to resolve this?

YoungjaeDev avatar Sep 02 '24 07:09 YoungjaeDev

Hi, could you please show me the logging?

ZhangYuanhan-AI avatar Sep 04 '24 02:09 ZhangYuanhan-AI

Anyone else relate to this?

YoungjaeDev avatar Sep 07 '24 05:09 YoungjaeDev