caffe-windows icon indicating copy to clipboard operation
caffe-windows copied to clipboard

lr in log does not change in AdaDelta solver

Open cheer37 opened this issue 9 years ago • 1 comments

Anyone tried to training with AdaDelta solver? 1, my log is printing "...sgd_solver.cpp:106] Iteration 2900" Why not adadelta_solver.cpp? this is normal? 2. as i know, learning rate changes automatically, but learning rate does not change from 1 passing iteration. Thanks in advance.

cheer37 avatar Mar 11 '16 13:03 cheer37

  1. YES its normal, sgd_solver.cpp is the file that prints the basic debug/status messages. I guess caffe has not been updated to give solver specific debug/status messages for each solver cpp files.
  2. YES learning rate should change automatically in Adadelta (has adaptive lr). I guess this issue still persists in caffe. I have not used Adaddelta as of now, hence not sure as to the correct procedure for proper use of adadelta solver in caffe i.e. without facing learning rate issues.

rakmuga avatar Dec 05 '17 11:12 rakmuga