ML-DL-implementation icon indicating copy to clipboard operation
ML-DL-implementation copied to clipboard

Implementing other "Optimized Gradient Descent Variants"

Open kwanit1142 opened this issue 3 years ago • 0 comments

Is your feature request related to a problem? Please describe. In addition to Gradient Descent Variants from Research Papers, other more advanced optimizers are present as well.

Describe the solution you'd like https://ruder.io/optimizing-gradient-descent/ <----------(See this till more references will be uploaded) https://www.kdnuggets.com/2019/06/gradient-descent-algorithms-cheat-sheet.html

Describe alternatives you've considered Decide accordingly, whether to add classes in Optimizer.py or work on Optim Folder for this as well. Explore accordingly, and simultaneously add resources here.

kwanit1142 avatar Mar 18 '21 10:03 kwanit1142