Elastic-Weights-Consolidation icon indicating copy to clipboard operation
Elastic-Weights-Consolidation copied to clipboard

Pytorch implementations of Elastic Weight Consolidation (EWC)

EWC

Pytorch implementations of Elastic Weights Consolidation (EWC) and "Online" EWC.

Usage (Linux Platform)

1. Install Visdom

pip install visdom

2. Run Visdom

Enter 'visdom' in the command line

3. Run main.py

Without EWC

python main.py

EWC

python main.py --consolidate 

"Online" EWC

python main.py --consolidate --online     

Results

Online EWC

Performance

image

Loss

image

Reference

https://github.com/kuc2477/pytorch-ewc

https://github.com/ruinanzhang/Rotated_MNIST_Continual_Learning

DeepMind's paper Overcoming Catastrophic Forgetting, PNAS 2017.