caffe-windows
caffe-windows copied to clipboard
lr in log does not change in AdaDelta solver
Anyone tried to training with AdaDelta solver? 1, my log is printing "...sgd_solver.cpp:106] Iteration 2900" Why not adadelta_solver.cpp? this is normal? 2. as i know, learning rate changes automatically, but learning rate does not change from 1 passing iteration. Thanks in advance.
- YES its normal, sgd_solver.cpp is the file that prints the basic debug/status messages. I guess caffe has not been updated to give solver specific debug/status messages for each solver cpp files.
- YES learning rate should change automatically in Adadelta (has adaptive lr). I guess this issue still persists in caffe. I have not used Adaddelta as of now, hence not sure as to the correct procedure for proper use of adadelta solver in caffe i.e. without facing learning rate issues.