improved-diffusion icon indicating copy to clipboard operation
improved-diffusion copied to clipboard

overfitting when training on cifar10

Open lowestbuaaer opened this issue 2 years ago • 2 comments

I trained a model on cifar10 with below settings. MODEL_FLAGS="--image_size 32 --num_channels 128 --num_res_blocks 3 --learn_sigma True --dropout 0.1" DIFFUSION_FLAGS="--diffusion_steps 4000 --noise_schedule linear" TRAIN_FLAGS="--lr 1e-4 --batch_size 16" but it overfits at 500k iterations. optimal point locates at about 300k iterations.(sample 100 steps, FID 4.7) Does anyone know possible reasons?

lowestbuaaer avatar May 16 '23 08:05 lowestbuaaer

maybe you check the dropout== 0.3 in readme,

99-WSJ avatar Jun 03 '23 08:06 99-WSJ

Hi, Did you solve it?

yug125lk avatar Dec 04 '23 14:12 yug125lk