Inference Extremely Slow - CUDA 11.4?

Open rudestmonk opened this issue 4 years ago • 2 comments

This was working just fine a few days ago, but as of yesterday inference has been super slow (as if it isn't running on the GPU). Is CUDA version 11.4 incompatible? Sort of dreading having to roll it back if so.

Sep 07 '21 16:09 rudestmonk

I'm using the same CUDA environment but not encounter these problem. Could you provide more software and hardware information?

Sep 26 '21 02:09 adahbingee

@adahbingee could you tell me which version of pytorch and cudatoolkit you installed, Thanks

Oct 17 '21 10:10 jixiang2016