BackwardsLinalg.jl
BackwardsLinalg.jl copied to clipboard
References
Paper
- symeig, lq, et. al https://arxiv.org/abs/1710.08717
- svd https://j-towns.github.io/papers/svd-derivative.pdf
- rsvd https://epubs.siam.org/doi/10.1137/090771806
- Einsum https://github.com/pytorch/pytorch/blob/4404762d7dd955383acee92e6f06b48144a0742e/aten/src/ATen/native/Linear.cpp#L125
- Lei-Wang's autodiff in TN paper (about increasing numerical stability) To be announced
Tensorflow
https://github.com/tensorflow/tensorflow/blob/master/tensorflow/python/ops/linalg_grad.py
Julia linalg autodiff
https://github.com/invenia/Nabla.jl