Surkov Kirill

Can confirm. I have the same issue, but with 64GB RAM, 24GB VRAM and alpaca-30b-lora-int4. `RuntimeError: [enforce fail at ..\c10\core\impl\alloc_cpu.cpp:72] data. DefaultCPUAllocator: not enough memory: you tried to allocate 238551040...

For me, the working solution is to increase the page or swap file to 64 GB. It won't be used, but for some reason it's needed.

@LLuanZZ try to run AltServer without sudo

Предложение очень хорошее! Но, к сожалению, это сломает ABI.