PETR icon indicating copy to clipboard operation
PETR copied to clipboard

loading pre-training weights for training

Open GuuuuuG opened this issue 2 years ago • 5 comments

Why is the loss still huge when loading pre-training weights for training, just like not loading them?

GuuuuuG avatar Aug 11 '22 01:08 GuuuuuG

Hi, can you provide config and run command?

yingfei1016 avatar Aug 12 '22 05:08 yingfei1016

image 9043a0dc6252b7a348c6e32b64bdb0c6

GuuuuuG avatar Aug 15 '22 01:08 GuuuuuG

Hi, You can send the config and log to my email: [email protected] .

yingfei1016 avatar Aug 15 '22 02:08 yingfei1016

@yingfei1016 Hi, I got the same problem when finetuning, could you please provide some solution for this ?

GlennLoveZhen0124 avatar Dec 23 '22 07:12 GlennLoveZhen0124

got the same problem when finetuning

Hi, Do you mean you have trained a model and then finetune it?

yingfei1016 avatar Dec 23 '22 09:12 yingfei1016