learning-rate-scheduling topic

optimizer & lr scheduler & loss function collections in PyTorch

kozistr

Gradient based Hyperparameter Tuning library in PyTorch

awslabs

Learning Rate Warmup in PyTorch

Tony-Y

Polynomial Learning Rate Decay Scheduler for PyTorch

cmpark0126

A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stopping and random seed.

Lance0218

A learning rate recommending and benchmarking tool.

git-disl

Automatic learning-rate scheduler

YuchenJin

Pytorch cyclic cosine decay learning rate scheduler

abhuse

sharpDARTS: Faster and More Accurate Differentiable Architecture Search

ahundt

Warmup learning rate wrapper for Pytorch Scheduler

lehduong