Annamae

Results 3 comments of Annamae

I'm experiencing a similar issue with 2x Nvidia 4060's (32GB in total), 64GB Ram. I can run a smaller model in either GPU without issues, but using both for a...

Yes I agree and thank you, downgrading is probably the best option but I have no idea how to integrate an older version of exllamav2 into Ooba. The current version...