asgd
asgd copied to clipboard
step_size0 should be cross validated on a small subset of the data
The constant η0 is determined by performing preliminary experiments on a data subsample.
http://leon.bottou.org/projects/sgd
We could also have a asgd.tune_...()
methods to "tune" speed and accuracy (here step_size0 would be optimized).
I'm working on this right now, implementing it as a mixin class.
That project is GPL btw, is this project GPL?
Code for determining step_size0 is included in PR #17