Some weights of T5ForConditionalGeneration were not initialized from the model checkpoint at google/flan-t5-base and are newly initialized: ['temp']

[ClarkQian]

Thank you very much for your outstanding work. However, when I was training vg_swinT.yaml, I encountered the following issue:

Some weights of T5ForConditionalGeneration were not initialized from the model checkpoint at google/flan-t5-base and are newly initialized: ['temp'] You should probably TRAIN this model on a downstream task to be able to use it for predictions and inference.

Moreover, the training results were only:

AP	AP50	AP75	APs	APm	APl	APr	APc	APf
0.013	0.027	0.010	0.001	0.007	0.057	0.000	0.001	0.025

Is this issue caused by the flan-t5-base model not loading correctly? I hope to get your advice on this matter. Thank you.

[xuxinxin99]

I get the same rersults with you, you are not alone! Hope for the author to answer it @clin1223