pytorch
pytorch copied to clipboard
Transpose scheduler plan
Tracking the remaining things needed for the transpose scheduler, the order is the priority:
- [x] Handle the case where the transposed dim is small (https://github.com/csarofeen/pytorch/pull/1910)
- [x] More validation on broadcasting
- [x] enable in registry
- [ ] enable transpose in python (https://github.com/csarofeen/pytorch/pull/1882, thanks @rdspring1, https://github.com/pytorch/pytorch/pull/84629, thanks @IvanYashchuk )
- [ ] More validation on trivial reduction
- [ ] Per-tensor fine-grained schedule for group 2 (see comment https://github.com/csarofeen/pytorch/pull/1906#pullrequestreview-1071496777)
- [ ] transpose + view
Here is Ivan's PR to enable transpose with primTorch: https://github.com/pytorch/pytorch/pull/84629