CTranslate2 icon indicating copy to clipboard operation
CTranslate2 copied to clipboard
verified publisher icon OpenNMT

[INFO] cuDNN with fusions

Open mnicely opened this issue 1 year ago • 1 comments

Hi, I came across this repo while wiring up Whisper support to my Bazaar. I just wanted to say amazing repo!

Diving through the code I noticed there was a mixture of cuBLAS and cuDNN. I wanted to let you know we just released cuDNN v9 and the new C++/Python Frontends. The new Graph API allows developers to fuse many combinations of ops such as Matmul + pointwise. If you're interested in more information, let me know. Again, super cool work!

mnicely avatar Feb 23 '24 14:02 mnicely

Hello, Thank you for your information. Currently, we don't plan to work on it, but we will see it more in detail.

minhthuc2502 avatar Mar 04 '24 17:03 minhthuc2502