loss-landscape topic

List loss-landscape repositories

how-do-vits-work

792
Stars
77
Forks
Watchers

(ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"

Implements sharpness-aware minimization (https://arxiv.org/abs/2010.01412) in TensorFlow 2.

loss-landscape-anim

123
Stars
22
Forks
Watchers

Create animations for the optimization trajectory of neural nets

LossLandscape

58
Stars
4
Forks
Watchers

Explores the ideas presented in Deep Ensembles: A Loss Landscape Perspective (https://arxiv.org/abs/1912.02757) by Stanislav Fort, Huiyi Hu, and Balaji Lakshminarayanan.