awesome-continual-learning
awesome-continual-learning copied to clipboard
A repository to keep track of literature on catastrophic forgetting
Awesome-continual-learning
Classic Literature
Catastrophic Forgetting in Connectionist Networks (French, 1999)
Rehearsal Based Incremental Learning
iCaRL: Incremental Classifier and Representation Learning, CVPR2017
(GEM) Gradient Episodic Memory for Continual Learning, NIPS17
(ER-Reservoir) On Tiny Episodic Memories in Continual Learning
Meta Learning Based Methods
(OML) Meta-Learning Representations for Continual Learning, NeurIPS19
(ANML) Learning to Continually Learn, ECAI 2020
Knowledge Distillation
Distilling the Knowledge in a Neural Network, 2015
Learning without Forgetting, 2016
Knowledge Retention Methods
(EWC)Overcoming catastrophic forgetting in neural networks, PNAS
(MAS) Memory Aware Synapses: Learning what (not) to forget, ECCV18
(SI) Continual Learning Through Synaptic Intelligence
Dual Memory Networks
FearNet: Brain-Inspired Model for Incremental Learning, ICLR18
Selective Networks
PathNet: Evolution Channels Gradient Descent in Super Neural Networks