localGPT icon indicating copy to clipboard operation
localGPT copied to clipboard

Published 20 hours ago • verified publisher icon PromtEngineer

Code is not using my GPU

Open ManalIrfan opened this issue 1 year ago • 1 comments

I have a 4GB 3070 and it takes over 15 minutes for a question to be answered. Ive looked through the resource manager as well and my GPU is not being used

ManalIrfan avatar Jun 06 '23 17:06 ManalIrfan

run python

import torch torch.cuda.is_available() Should be True

I had some issues - I had to downgrade the cuda version to 18.1 (iirc)

hreinn avatar Jun 06 '23 21:06 hreinn