luminal icon indicating copy to clipboard operation
luminal copied to clipboard

cuDNN

Open jafioti opened this issue 11 months ago • 0 comments

Currently we use cublas through the cudarc library for matmuls, which is very good for generic matmul performance. cuDNN has many more NN specific ops that can be leveraged specifically for stuff like convs and mlps. Not sure if cudarc has this or if we'll need another library for it

jafioti avatar Mar 03 '24 20:03 jafioti