optimizers topic

Code for the paper "Facial Emotion Recognition: State of the Art Performance on FER2013"

usef-kh

Accelerated tensor operations and dynamic neural networks based on reverse mode automatic differentiation for every device that can run Swift - from watchOS to Linux

palle-k

Neutron: A pytorch based implementation of Transformer and its variants.

hfxunlp

Lookahead mechanism for optimizers in Keras.

CyberZHG

Improved Hypergradient optimizers, providing better generalization and faster convergence.

harshalmittal4

A high level deep learning library for Convolutional Neural Networks,GANs and more, made from scratch(numpy/cupy implementation).

ShivamShrirao

Summarize Massive Datasets using Submodular Optimization

decile-team

Toy implementations of some popular ML optimizers using Python/JAX

shreyansh26

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

lucidrains

Optim4RL is a Jax framework of learning to optimize for reinforcement learning.

sail-sg