Frédéric Bastien comments

Results 185 comments of


                                            Frédéric Bastien

CuDNN Initialization Error with Pre-existing CUDA Environment Fails with

You don't have a normal setup. There isn't doc for it. Some of the packages above are provided by the cuda sdk. But cudnn and nccl isn't. Can you try...

CuDNN Initialization Error with Pre-existing CUDA Environment Fails with

You probably installed too many packages. I don't think this is an issue. Should we close this issue?

[CUDA] Overview of CPU/GPU synchronization methods

Instead of using cudaMalloc/cudaFree, did you look at CUDA stream ordered allocation: (cudaMallocAsync/cudaMallocFree) The free isn't blocking. A blog post about this: https://developer.nvidia.com/blog/using-cuda-stream-ordered-memory-allocator-part-1/ Also, allocation and free are much faster.

Running a warp kernel from Jax JIT-compiled function

Hi, There isn't any easy way to do this right now. To be able to use it in JAX *without* jit, you could make a JAX primitive in Python. But...

Running a warp kernel from Jax JIT-compiled function

I don't think it is trivial. But it could be mechanical. That part of the code isn't simple. You can base yourself on the jax-triton code. This jax custom operation...