cutile-python
cutile-python copied to clipboard
Custom backward pass?
Does cuTile support a custom backward pass? It wasn't clear from the examples. This is obviously needed to training and something that triton supports. thanks!
Hi @vgoklani, you can find a backward kernel example here.
thanks @haijieg do you have one for flash attention?
@vgoklani no, we don't. Please feel free to file a feature request and this will be a good one to get community contribution on.