PINNs icon indicating copy to clipboard operation
PINNs copied to clipboard

why two optimizers are needed during the training?

Open manwu1994 opened this issue 2 years ago • 1 comments

Hello, thanks a lot for your hard work and your sharing. I would like to ask why two optimizers are needed during the training. self.optimizer.step(self.loss_func) self.optimizer_Adam.step()

Thank you so much in advance for your answers.

manwu1994 avatar Oct 15 '22 05:10 manwu1994

Hi,

The original PINN uses two optimizers, Adam for initial optimization since it is generally more stable, and later use second order optimizer LBFGS for finetuning to reach higher accuracy.

jayroxis avatar Oct 17 '22 04:10 jayroxis