VILA icon indicating copy to clipboard operation
VILA copied to clipboard

Question re. LanguageModel vs LanguageModelForCausalLM functionalies

Open orrzohar opened this issue 1 year ago • 2 comments

Hi,

Why did you refactor such that the model is of type 'LanguageModel' and not 'LanguageModelForCausalLM'? and why did you move 'get_vision_tower'/etc from 'LlavaMetaForCausalLM' to 'LlavaMetaModel'?

Best, Orr

orrzohar avatar Jul 24 '24 21:07 orrzohar