Boris Shor
Results
31
comments of
Boris Shor
I have the same problem as @semidark with the 12b-qat model overfilling VRAM on my 12Gb 4070, while the regular 12b-Q4_K_M model doing just fine.