optimizers topic

List optimizers repositories

awesome-optimizers

40
Stars
9
Forks
Watchers

Neural Network optimizers implemented from scratch in numpy (Adam, Adadelta, RMSProp, SGD, etc.)

flaxOptimizers

27
Stars
1
Forks
Watchers

A collection of optimizers, some arcane others well known, for Flax.

annotated_deep_learning_paper_implementations

29.4k
Stars
3.1k
Forks
347
Watchers

🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(c...

Gradient-Centralization-TensorFlow

101
Stars
20
Forks
Watchers

Instantly improve your training performance of TensorFlow models with just 2 lines of code!

keras-adamw

161
Stars
24
Forks
Watchers

Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers

keras-radam

326
Stars
47
Forks
Watchers

RAdam implemented in Keras & TensorFlow

axon

1.1k
Stars
67
Forks
Watchers

Nx-powered Neural Networks

frostnet

101
Stars
18
Forks
Watchers

FrostNet: Towards Quantization-Aware Network Architecture Search

opytimizer

545
Stars
34
Forks
Watchers

🐦 Opytimizer is a Python library consisting of meta-heuristic optimization algorithms.