optimizers topic

List optimizers repositories

awesome-optimizers

45
Stars
11
Forks
Watchers

Neural Network optimizers implemented from scratch in numpy (Adam, Adadelta, RMSProp, SGD, etc.)

flaxOptimizers

29
Stars
1
Forks
Watchers

A collection of optimizers, some arcane others well known, for Flax.

annotated_deep_learning_paper_implementations

49.2k
Stars
5.1k
Forks
347
Watchers

🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gan...

Gradient-Centralization-TensorFlow

106
Stars
21
Forks
Watchers

Instantly improve your training performance of TensorFlow models with just 2 lines of code!

keras-adamw

167
Stars
25
Forks
Watchers

Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers

keras-radam

324
Stars
46
Forks
Watchers

RAdam implemented in Keras & TensorFlow

axon

1.5k
Stars
99
Forks
Watchers

Nx-powered Neural Networks

frostnet

106
Stars
18
Forks
Watchers

FrostNet: Towards Quantization-Aware Network Architecture Search

opytimizer

595
Stars
41
Forks
Watchers

🐦 Opytimizer is a Python library consisting of meta-heuristic optimization algorithms.