tick icon indicating copy to clipboard operation
tick copied to clipboard

Improvement of SGD and base classes for stochastic solvers

Open stephanegaiffas opened this issue 7 years ago • 0 comments

Currently SGD is very monolithic and cannot be tuned enough. More flexibility in the tuning of learning rates and Polyak Ruppert average should be implemented (easy). Handling of sparse features as well (easy). This could also be done by adding base classes, since for now there is only StoSolver, while some more concept could be mutualized through solvers (variance reduction, averaging, etc...)

stephanegaiffas avatar Oct 05 '17 16:10 stephanegaiffas