low amplitude component problem

[AlexG9908]

Thanks for sharing the code! I've got some questions on FBPINN to solve nonlinear problem, the u solved with PINN contains multiple frequencies. Although FBPINN can cope well with high frequencies, there is a big difference in the amplitude of the different frequency components, so the solution has a big error to the low amplitude component, e.g. the actual value of u is the 20Hz component with amplitude 1 + the 1Hz component with amplitude 0.001. I was wondering if FBPINN could add learning rate decay to learn components with smaller amplitudes later in the training process. Or there are other ways to do it. Thanks.