optimizer topic
Post-Tweaks
A post-installation batch script for Windows
keras-adabound
Keras implementation of AdaBound
adamwr
Implements https://arxiv.org/abs/1711.05101 AdamW optimizer, cosine learning rate scheduler and "Cyclical Learning Rates for Training Neural Networks" https://arxiv.org/abs/1506.01186 for PyTorch fram...
EAGO.jl
A development environment for robust and global optimization
torchopt
TorchOpt is an efficient library for differentiable optimization built upon PyTorch.
LAMB_Optimizer_TF
LAMB Optimizer for Large Batch Training (TensorFlow version)
Adan-pytorch
Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch