TinyLLaVA_Factory
TinyLLaVA_Factory copied to clipboard
About share recipe. Should change "tune_type_vision_tower" to set to "partially-tune"?
Dear author, I found that "--tune_type_vision_tower" is frozen in pretrain_share.sh, according to the paper, should I change "tune_type_vision_tower" to set to "partially-tune", and set "tune_vision_tower_from_layer" to 12.
Not necessary doing so. We find that for share recipe, keeping vision tower fully frozen works as well as partially-tuning it. So no need to partially-tune vision tower as described in our tech report.