caffe icon indicating copy to clipboard operation
caffe copied to clipboard

Update sgd_solver for LARS

Open minkkang opened this issue 5 years ago • 0 comments

We change the SGDFusion flow("normalize" -> "GetLocalRate" -> "regularization & update") and the NON-SGDFusion flow("normalize" -> "GetLocalRate" -> "regularization" -> "update") for LARS.

In original intel-caffe code, only SGD(Not NESTEROV, ADAGRAD, RMSPROP, ADADELTA, ADAM) adapted LARS. So, we change only the flow of SGD.

For more information, please refer to #256

minkkang avatar Mar 12 '19 06:03 minkkang