Loss doesn't converge

[yashkhurana24]

Hello, I'm trying to denoise a 2D image. I add synthetic noise as follows: np.array(np.random.poisson(0.01 * x / 0.1) / 0.01 But the loss doesn't converge. I have several different learning rates. Can you help me out?

[zejinwang]

If the training set is small, you'd better set the initial learning rate to 10 times larger. Besides, it is normal that the trend of decreasing loss is not obvious.