Compatibility With CUDA 12

[MatCorr]

❓ Questions and Help

Is there a way to install Xformers with CUDA 12?

I'm trying to use Xformers on a Singularity image that employs, as a base, an image from the Nvidia PyTorch catalog, which are all optimized for the GPUs I'm using.

However, the more up-to-date versions of those PyTorch images all come with CUDA 12 installed. Because of that, when I install Xformers, PyTorch is rebuilt with CUDA version 11.7. This, in turn, causes an incompatibility between the versions of NVCC (which remains 12) and the CUDA of PyTorch (which reverts to 11.7), and I suspect some bugs I'm encountering when training models are related to this disparity.