ML-DL-implementation
ML-DL-implementation copied to clipboard
Implementing other "Optimized Gradient Descent Variants"
Is your feature request related to a problem? Please describe. In addition to Gradient Descent Variants from Research Papers, other more advanced optimizers are present as well.
Describe the solution you'd like https://ruder.io/optimizing-gradient-descent/ <----------(See this till more references will be uploaded) https://www.kdnuggets.com/2019/06/gradient-descent-algorithms-cheat-sheet.html
Describe alternatives you've considered Decide accordingly, whether to add classes in Optimizer.py or work on Optim Folder for this as well. Explore accordingly, and simultaneously add resources here.