CLR
CLR copied to clipboard
How to reset the lr cycle
Dear @bckenstler ,
recently I stumbled across an issue with CLR calling from keras 2.1.5: I ran using
CyclicLR(base_lr=1e-5, max_lr=8e-4, mode='triangular2', step_size=trn_steps//10, scale_mode='iterations')
where trn_steps
is equal to steps_per_epoch
in model.fit_generator
.
Now, my observation is that during the first epoch CLR goes through 10 cycles (as planned), but then lr stays constant throughout the remaining epochs. How do I properly reset the lr cycle? I tried scale_mode='cycle'
as well, but no luck. What am I doing wrong?