stanford_alpaca icon indicating copy to clipboard operation
stanford_alpaca copied to clipboard

Published 20 hours ago • verified publisher icon tatsu-lab

Due to OOM, who can finetune LLaMA using bitsandbytes for an 8-bit setting on a single 3090?

Open linhduongtuan opened this issue 2 years ago • 0 comments

Dear @all Due to OOM as mentioned in previous issues, who can finetune LLaMA using bitsandbytes for an 8-bit setting on a single 3090? If yes, please share your experiments and experience.

Best regards, Linh

linhduongtuan avatar Mar 16 '23 11:03 linhduongtuan