sgcrfpy icon indicating copy to clipboard operation
sgcrfpy copied to clipboard

add max number of backtracking iterations, and early stopping

Open dswah opened this issue 9 years ago • 2 comments

dswah avatar Aug 02 '16 22:08 dswah

look up the stopping criterion that uses norm of gradient and norm of loss!

dswah avatar Aug 16 '16 18:08 dswah

sometimes, the algorithm will propose a step direction, and then spend a long time backtracking until the learning rate is machine epsilon. perhaps instead of taking a really small step in a bad direction, we should just stop?

dswah avatar Oct 14 '16 21:10 dswah