qlora
qlora copied to clipboard
Update qlora.py
add n_gpus = 0 default value to get_accelerate_model
Fixes this error:
Traceback (most recent call last):
File "qlora.py", line 841, in
HI @rain-1, the way QLoRA was set up with Bitsandbytes requires GPUs and doesn't work with CPU only. I don't think we should have a base case of n_gpu=0.