deepxde icon indicating copy to clipboard operation
deepxde copied to clipboard

Published 20 hours ago • verified publisher icon lululxvi

L-BFGS

Open tanmay2798 opened this issue 1 year ago • 1 comments

I wanted to ask that why after using L-BFGS with pytorch in https://i-systems.github.io/tutorial/KSNVE/220525/01_PINN.html significantly reduces the loss value?

tanmay2798 avatar Feb 25 '24 04:02 tanmay2798

The question is fundamental to optimisers. While, second order optimisers are known for faster convergence, this is not generally true in cases where the loss lanscape contains saddle points.

praksharma avatar Feb 26 '24 13:02 praksharma