CUBLAS.jl Integration
Not sure if you're aware but there is an existing CUBLAS package for Julia - https://github.com/nwh/CUBLAS.jl/tree/master/src
If there are more CUBLAS methods that need to be implemented then it might be worth integrating with it.
@JobJob Thanks for the pointer! I was not aware of this package.
Yes, it's good to keep this in mind, and maybe make use of this in the future if we need more functions from cuBLAS. But I found it even more interesting to learn from the implementation of cublas.jl that there are tools like Clang.jl that could use to parse C header files and generate stubs. This should be much more convenient and less error-prone.
Ok nice. Yeah I was a little worried when I was working on cudnn.jl that such a tool existed and that you'd been using it to generate the cuda code : ) Manually interfacing with the C calls is indeed fiddly.