Open-LLaVA-NeXT icon indicating copy to clipboard operation
Open-LLaVA-NeXT copied to clipboard

Published 20 hours ago • verified publisher icon xiaoachen98

Is the param "self.image_newline" only tuned in SFT?

Open huangrh99 opened this issue 8 months ago • 1 comments

I found that the 'self.image_newline' in LlavaMetaModel was not tuned during the pre-training stage. Have you tried enabling this parameter during pre-training?

huangrh99 avatar Jun 05 '24 06:06 huangrh99