added shampoo optimizer from https://github.com/jettify/pytorch-opti…

[rokosbasilisk]

…mizer/blob/master/torch_optimizer/shampoo.py

[StellaAthena]

#authors:
 #  - family-names: Novik
 #    given-names: Mykola
 #    orcid: https://orcid.org/0000-0002-0890-1159
 #title: "torch-optimizer -- collection of optimization algorithms for PyTorch."
 #version: 1.0.1
 #date-released: 2020-01-11

This is the original author, not you, right?

[rokosbasilisk]

yes added the same

[rokosbasilisk]

okay, doing.

[StellaAthena]

okay, doing.

Thanks!

[StellaAthena]

@rokosbasilisk any updates?

[rokosbasilisk]

added a sample config at configs/small_shampoo.yml

[StellaAthena]

I know I need to test and merge this, just haven’t gotten around to it :S Hopefully in the next couple days I can.

[StellaAthena]

Closing as too far behind main to be merged. May require substantial refactors to get working.