denoising-diffusion-pytorch icon indicating copy to clipboard operation
denoising-diffusion-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon lucidrains

Loss size

Open cajoek opened this issue 3 years ago • 2 comments

Hi!, What loss (L1 and L2) should I expect for a properly trained model? And which loss usually performs better?

cajoek avatar Mar 12 '22 19:03 cajoek

Hi!, What loss (L1 and L2) should I expect for a properly trained model? And which loss usually performs better?

In paper "https://arxiv.org/abs/2111.05826" has some discuss about L1 loss and L2 loss

wangqiang9 avatar Mar 22 '22 07:03 wangqiang9

Thanks @XDUWQ, very helpful! Do you by any chance have any input on this https://github.com/lucidrains/denoising-diffusion-pytorch/issues/4#issuecomment-1075353556?

cajoek avatar Mar 22 '22 17:03 cajoek