TinyLLaVA_Factory icon indicating copy to clipboard operation
TinyLLaVA_Factory copied to clipboard

About share recipe. Should change "tune_type_vision_tower" to set to "partially-tune"?

Open NyKxo1 opened this issue 1 year ago • 1 comments

Dear author, I found that "--tune_type_vision_tower" is frozen in pretrain_share.sh, according to the paper, should I change "tune_type_vision_tower" to set to "partially-tune", and set "tune_vision_tower_from_layer" to 12.

NyKxo1 avatar Aug 07 '24 05:08 NyKxo1

Not necessary doing so. We find that for share recipe, keeping vision tower fully frozen works as well as partially-tuning it. So no need to partially-tune vision tower as described in our tech report.

TinyLLaVA avatar Aug 15 '24 05:08 TinyLLaVA