Question on validation loss

[Sirius083]

I have implemented your code on cifar100 when halving the learning rate, the test loss suddenly decrease , then increase while the validation error keeps unchanged. Did tensorpack maintain a shadow value and show the EMA of cost? (reset this value after learning rate change)

Any suggesstion would be appreciated Thanks in advance