Why freeze the first stage_1 freeze_qformer Settings to True?

[sujaly]

When I was ready for the first phase of pre-training, I found that the freeze_qformer was frozen. The purpose of the first stage of pre-training is for the freeze_qformer to learn the representation of the image, so why freeze it here?

model: arch: mini_gpt4 model_type: pretrain_vicuna freeze_vit: True freeze_qformer: True