Arraymancer icon indicating copy to clipboard operation
Arraymancer copied to clipboard

Published 20 hours ago • verified publisher icon mratsim

Einsum backpropagation

Open mratsim opened this issue 4 years ago • 0 comments

After #363 we have einsum, but we can't backprop through it.

Einsum backprop implementation:

  • https://github.com/rsokl/MyGrad/blob/5ea7b929108c90a83c37c3d619cef0a6f6596e28/mygrad/linalg/ops.py#L161-L280
  • https://github.com/tensorflow/tensorflow/blob/eb9b2659f831c5ac60eb833dc4d04a161e588833/tensorflow/python/ops/special_math_ops.py#L137-L157

I'm not too sure how it works in PyTorch, seems magical: https://github.com/pytorch/pytorch/pull/6307/files

mratsim avatar Jul 13 '19 20:07 mratsim