pytorch_optimizer icon indicating copy to clipboard operation
pytorch_optimizer copied to clipboard

Published 20 hours ago • verified publisher icon kozistr

[Feature request]REX LR scheduler

Open sdbds opened this issue 1 year ago • 1 comments

Paper or Code

REX LR scheduler From https://arxiv.org/abs/2107.04197

Implementation is based on https://github.com/Nerogar/OneTrainer/blob/2c6f34ea0838e5a86774a1cf75093d7e97c70f03/modules/util/lr_scheduler_util.py#L66

sdbds avatar Jan 10 '24 07:01 sdbds

thanks! I'll look into it :)

kozistr avatar Jan 20 '24 07:01 kozistr

now you can check the implementation on the latest main branch :)

kozistr avatar Mar 02 '24 09:03 kozistr