cudarc icon indicating copy to clipboard operation
cudarc copied to clipboard

Published 20 hours ago • verified publisher icon coreylowman

More cudnn ops

Open LaurentMazare opened this issue 11 months ago • 3 comments

Thanks for this amazing crate, it's been instrumental to candle. We've recently added a feature to use the cudnn conv2d which sped things up a lot compared to our handcrafted kernel, and would like to have cudnn support for more ops. Mostly interested in:

  • Conv2d backprop.
  • Conv1d forward + backward.
  • Maybe flash-attention/softmax/... Are there any plans to add these to the cudnn safe api? If not would you be ok with people making PR to add it?

LaurentMazare avatar Aug 23 '23 10:08 LaurentMazare