asgd icon indicating copy to clipboard operation
asgd copied to clipboard

step_size0 should be cross validated on a small subset of the data

Open npinto opened this issue 13 years ago • 3 comments

The constant η0 is determined by performing preliminary experiments on a data subsample.

http://leon.bottou.org/projects/sgd

We could also have a asgd.tune_...() methods to "tune" speed and accuracy (here step_size0 would be optimized).

npinto avatar Nov 17 '11 03:11 npinto

I'm working on this right now, implementing it as a mixin class.

jaberg avatar Jan 18 '12 16:01 jaberg

That project is GPL btw, is this project GPL?

jaberg avatar Jan 18 '12 16:01 jaberg

Code for determining step_size0 is included in PR #17

jaberg avatar Jan 18 '12 19:01 jaberg