pytorch-meta-optimizer icon indicating copy to clipboard operation
pytorch-meta-optimizer copied to clipboard

A PyTorch implementation of Learning to learn by gradient descent by gradient descent

Intro

PyTorch implementation of Learning to learn by gradient descent by gradient descent.

Run

python main.py

TODO

  • [x] Initial implementation
  • [x] Toy data
  • [x] LSTM updates
  • [ ] Refactor, find a better way to organize the modules
  • [ ] Compare with standard optimizers
  • [x] Real data
  • [ ] More difficult models