denoising-diffusion-pytorch icon indicating copy to clipboard operation
denoising-diffusion-pytorch copied to clipboard

Train with Self-Conditoning and Generate without Gives better results

Open Leo-T-Zang opened this issue 2 years ago • 1 comments

Hi Phil and all diffusion coder here,

I am using this diffusion codes for latent text generation. After some testing, I found out if I trained my denoising model with self-conditiong and generate content without it will give me more naturally good results.

So I am curious if it is explainable and if we are supposed to use same setting for training and generation.

Thanks.

Leo-T-Zang avatar Aug 30 '23 20:08 Leo-T-Zang

@Leo-T-Zang share a weights and bias report?

lucidrains avatar Aug 31 '23 23:08 lucidrains