denoising-diffusion-pytorch icon indicating copy to clipboard operation
denoising-diffusion-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon lucidrains

Alpha schedule instead of beta schedule?

Open askerlee opened this issue 2 years ago • 0 comments

In the "Improved Denoising Diffusion Probabilistic Models" paper, the authors claim that cosine schedule of beta makes alpha-bar change more smoothly, leading to better results. Then I wonder why not linearly schedule alpha-bar, instead of beta? We can compute beta from alpha-bar. Anyone tried that?

askerlee avatar May 18 '22 08:05 askerlee