Elias Nehme

icon indicating a website link https://eliasnehme.github.io/

icon company Technion - IIT icon location Haifa, Israel icon location Ph.D. Candidate in Electrical Engineering working at the intersection of Computational Imaging and Machine Learning

Results 1 issues of Elias Nehme

Missing activation for the time embedding inside ResidualBlock for DDPM?

3 comment

In the DDPM Unet implementation, the residual blocks incorporate the time embedding by applying a linear layer only with no prior activation: https://github.com/labmlai/annotated_deep_learning_paper_implementations/blob/b1f5c8e3a5f08bb195698b0410340b1dc2d8c821/labml_nn/diffusion/ddpm/unet.py#L130 However, the positionally encoded time embedding is...

bug