sgd icon indicating copy to clipboard operation
sgd copied to clipboard

"Warm start"

Open dustinvtran opened this issue 9 years ago • 0 comments

Randomly initialize at 0 with normally distributed epsilon, say, eps=1e-5 standard deviation. See #58.

To tune hyperparameters: run SGD to get best estimates for a particular choice of hyperparameters. Then use this estimate as the starting point for running SGD for the next choice of hyperparameters during the grid search (continue to perturb with normally distributed epsilon error)

dustinvtran avatar Jun 26 '15 17:06 dustinvtran