NGD-SGD

A Pytorch Implementation of Natural Gradient Descent

Installation

Install PyTorch 1.1.0 with Tensorboard support

pip install tb-nightly
pip install future

Run

go to examples/image_classification/ and run ./run_ngd_wrn.sh

TODO

We will add more examples and experiments in the future