CLIP icon indicating copy to clipboard operation
CLIP copied to clipboard

My CUDA Has seen the GPU but did not use it, why?

Open Mark-ssss opened this issue 1 year ago • 2 comments

it seems like: torch.cuda.device_count()=1, but torch.cuda.current_device()=0.... What I 've got: NVIDIA GeForce GTX 1650 Ti CUDA available: True (version:11.1) cuDNN enabled: True(version:8.9.729) pytorch 1.9.0 torchvision 0.10.0 prettytable easydict

Mark-ssss avatar May 16 '24 17:05 Mark-ssss

QQ截图20240517014552 it comes out just like this orz....

Mark-ssss avatar May 16 '24 17:05 Mark-ssss

Have you manually moved your tensors into VRAM?

model = model.to("cuda")

cohml avatar Oct 15 '24 20:10 cohml