lightning
lightning copied to clipboard
Automatic step size in SVRG
The theory gives step sizes for which the algorithms are guaranteed to converge (see papers). We need to add an eta="auto" option.
done for SAG in #42, still needs to be done for SVRG