tch-rs icon indicating copy to clipboard operation
tch-rs copied to clipboard

LBFGS Support

Open joverwey opened this issue 3 years ago • 0 comments

Is there a reason why LBFGS is not supported as an optimizer? Would it be hard to add?

For Style Transfer, I've noticed that it converges much faster than AdamW when used from Python.

Also see this comparison with other optimizers: https://blog.slavv.com/picking-an-optimizer-for-style-transfer-86e7b8cba84b

joverwey avatar May 31 '21 17:05 joverwey