LeeEdel

K-FAC has gotten some updates and new press: https://jimmylba.github.io/papers/nsync.pdf https://www.inboxdb.com/import-ai-cheaper-neural-network-training-mysterious-claims-around-bayesian-program/ "Half-price neural networks thanks to algorithmic tweaks: new research, Distributed Second-Order Optimization Using Kronecker-Factored Approximations (PDF), creates a new optimization...

I'll probably try that out!

@wangxiaodong1021 I emailed the authors awhile ago about getting a copy of it. Last I heard they were cleaning the code up a bit before posting it.