autoencoding_beyond_pixels icon indicating copy to clipboard operation
autoencoding_beyond_pixels copied to clipboard

n_augment

Open nationalflag opened this issue 9 years ago • 7 comments

could you tell me how "n_augment" works?

nationalflag avatar Mar 15 '16 03:03 nationalflag

It creates an augmented version of the dataset containin n_augment samples. For the CelebA dataset it doesn't really help and you might simply set n_augment=0 in which disables augmentation.

andersbll avatar Mar 15 '16 04:03 andersbll

Should I decrease the complexity of the model to decrease parameters and avoid overfitting when I set n_augment=0?

nationalflag avatar Apr 06 '16 02:04 nationalflag

No, that is not my experience. Are we talking CelebA?

andersbll avatar Apr 06 '16 07:04 andersbll

Yes. I try to implement your algorithm on my own and my model's parameters are no more than yours, but my model seems to overfit because the validation error increases after several epochs. I guess maybe it is because i don't augment the CelebA data ?

nationalflag avatar Apr 06 '16 08:04 nationalflag

What are you measuring as validation error?

andersbll avatar Apr 06 '16 08:04 andersbll

The reconstruction error — second term in your loss function

nationalflag avatar Apr 06 '16 09:04 nationalflag

Ok, I wouldn't worry about that since the reconstruction error is measured in a feature space. The scale of the feature representation may increase over time which leads to larger reconstruction errors. I guess this is what you are observing.

andersbll avatar Apr 06 '16 09:04 andersbll