ScottSump

it says it's been updated, but when I uninstall and reinstall, I still get the same error. exllamav2 works fine with 12.1, so it's not the CUDA. I'm still guessing...

Hi Juan, thanks so much for answering. It's the code from your gist here: https://gist.github.com/juanmc2005/ed6413e697e176cb36a149d8c40a3a5b Doing some stuff with the kids this weekend so can't get back to it until...