CLR icon indicating copy to clipboard operation
CLR copied to clipboard

How to reset the lr cycle

Open iNLyze opened this issue 6 years ago • 0 comments

Dear @bckenstler ,

recently I stumbled across an issue with CLR calling from keras 2.1.5: I ran using

CyclicLR(base_lr=1e-5, max_lr=8e-4, mode='triangular2', step_size=trn_steps//10, scale_mode='iterations')

where trn_steps is equal to steps_per_epoch in model.fit_generator.

Now, my observation is that during the first epoch CLR goes through 10 cycles (as planned), but then lr stays constant throughout the remaining epochs. How do I properly reset the lr cycle? I tried scale_mode='cycle' as well, but no luck. What am I doing wrong?

iNLyze avatar Apr 07 '18 21:04 iNLyze