optimizers topic

Neural Network optimizers implemented from scratch in numpy (Adam, Adadelta, RMSProp, SGD, etc.)

ivallesp

A collection of optimizers, some arcane others well known, for Flax.

nestordemeure

🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gan...

labmlai

Instantly improve your training performance of TensorFlow models with just 2 lines of code!

Rishit-dagli

Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers

OverLordGoldDragon

RAdam implemented in Keras & TensorFlow

CyberZHG

Nx-powered Neural Networks

elixir-nx

FrostNet: Towards Quantization-Aware Network Architecture Search

clovaai

A New Optimization Technique for Deep Neural Networks

Yonghongwei

🐦 Opytimizer is a Python library consisting of meta-heuristic optimization algorithms.

gugarosa