generalization topic
modules
The official repository for our paper "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks". We develop a method for analyzing emerging functional modularity...
ndr
The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".
Meta-set
Automatic model evaluation (AutoEval) in CVPR'21&TPAMI'22
limit-label-memorization
Improving generalization by controlling label-noise information in neural network weights.
Generalizing-Lottery-Tickets
This repository contains code to replicate the experiments given in NeurIPS 2019 paper "One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers"
object-centric-library
Library for the training and evaluation of object-centric models (ICML 2022)
In-Time-Over-Parameterization
[ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, Decebal Constantin Mocanu, Mykola Pechenizkiy
sgd-sparse-features
SGD with large step sizes learns sparse features [ICML 2023]
understanding-sam
Towards Understanding Sharpness-Aware Minimization [ICML 2022]
paper-notes
ML/DL/RL paper notes