deep-image-prior icon indicating copy to clipboard operation
deep-image-prior copied to clipboard

Published 20 hours ago • verified publisher icon DmitryUlyanov

About Weight decay for the network

Open Shaosifan opened this issue 5 years ago • 1 comments

I find that the weight decay of network is not used in the optimization. So I try to set weight decay (0.0001) in the Adam function, and the PSNR of the reconstruction relative to reference truth begins to fluctuate.

Do you observe this phenomenon? Is it better not to use weight decay in such unsupervised network?

Shaosifan avatar Apr 30 '19 08:04 Shaosifan

PSNR

Shaosifan avatar Apr 30 '19 08:04 Shaosifan