One_Cycle_Policy
One_Cycle_Policy copied to clipboard
Published
20 hours ago •
nachiket273
nachiket273
Pytorch notebook with One Cycle Policy implementation (https://arxiv.org/abs/1803.09820)
Cyclic Learning Rates and One Cycle Policy.
This notebook contains some of the experiments mentioned in papers Cyclical Learning Rates for Training Neural Networks and A disciplined approach to neural network hyper-parameters: Part 1 - learning rate, batch size, momentum, and weight decay. My blog related to the same can be found here
This notebook works with:
- Python 3.6+
- Pytorch 0.3.x
Metadata
73
Stars
13
Forks
Watchers
Owner
nachiket273
Metadata
Pytorch notebook with One Cycle Policy implementation (https://arxiv.org/abs/1803.09820)