TinyLLaVA_Factory icon indicating copy to clipboard operation
TinyLLaVA_Factory copied to clipboard

Did you train the whole LLM in the pretraining stage of share recipe?

Open Yang-bug-star opened this issue 1 year ago • 3 comments

Yang-bug-star avatar Mar 20 '24 07:03 Yang-bug-star

No, vision tower was not trained.

baichuanzhou avatar Mar 20 '24 11:03 baichuanzhou

oh,what i meant is that whether the language model was pre-trained in share training recipe, it's clear  that the  vision encoder was trained in pretraining of share recipe. 

---Original--- From: @.> Date: Wed, Mar 20, 2024 19:10 PM To: @.>; Cc: @.@.>; Subject: Re: [DLCV-BUAA/TinyLLaVABench] Did you train the whole LLM in the pretraining stage of share recipe? (Issue #34)

No, vision tower was not trained.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

Yang-bug-star avatar Mar 20 '24 12:03 Yang-bug-star

Then, yes.

baichuanzhou avatar Mar 20 '24 13:03 baichuanzhou