awatuna
Results
3
comments of
awatuna
it turns out loading the 30B 4bit model needs over 90G ram, make sure your swap is big enough.
@oobabooga Windows allocates swap for committed memory. I have 64G with 8G swap and it fails right away. Set swap to auto and free up the swap drive to let...
big swap means big swap 65*3 - 64G ram + 10G headroom ~= 140G swap