self-rag icon indicating copy to clipboard operation
self-rag copied to clipboard

Published 20 hours ago • verified publisher icon AkariAsai

4 bit quantized version of 7B?

Open djkazic opened this issue 10 months ago • 0 comments

Unquantized 7B requires lots of VRAM (> 12GB).

djkazic avatar Mar 25 '24 12:03 djkazic