Awesome-continual-learning

Classic Literature

Catastrophic Forgetting in Connectionist Networks (French, 1999)

Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory

Rehearsal Based Incremental Learning

iCaRL: Incremental Classifier and Representation Learning, CVPR2017

MER : Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interference, ICLR19

(GEM) Gradient Episodic Memory for Continual Learning, NIPS17

(ER-Reservoir) On Tiny Episodic Memories in Continual Learning

Meta Learning Based Methods

(OML) Meta-Learning Representations for Continual Learning, NeurIPS19

(ANML) Learning to Continually Learn, ECAI 2020

Knowledge Distillation

Distilling the Knowledge in a Neural Network, 2015

Learning without Forgetting, 2016

Knowledge Retention Methods

(EWC)Overcoming catastrophic forgetting in neural networks, PNAS

(MAS) Memory Aware Synapses: Learning what (not) to forget, ECCV18

(SI) Continual Learning Through Synaptic Intelligence

Dual Memory Networks

FearNet: Brain-Inspired Model for Incremental Learning, ICLR18

Selective Networks

(XdG) Alleviating catastrophic forgetting using contextdependent gating and synaptic stabilization, PNAS

PathNet: Evolution Channels Gradient Descent in Super Neural Networks