Decaying Functions of alpha and epsilon

[Bahador-Bakhshi]

Different approaches can be used for decaying the alpha and epsilon, for example alpha = alpha0 / (1 + iteration * decay)

[Bahador-Bakhshi]

Have a look at "Learning Rate Scheduling" in the "Hands On ..." book